What do you use for test rendering your dev site?
-
I'm redesigning our company ecommerce site and need to test render an infinite scroller to ensure that it is as SEO friendly as possible. My problem is that I cannot view it in Webmaster Tools since I am blocking the site from crawlers using robots.txt. I know I could simply unblock Google temporarily but I really would rather not make my dev site available to search engine crawlers.
-
Screaming Frog
-
Hi Tyler. You can use a text browser like Lynx as that's a close approximation of how Google "sees" your site. From: https://support.google.com/webmasters/answer/40349...
Use a text browser, such as Lynx, to examine your site. Most spiders see your site much as Lynx would. If features such as JavaScript, cookies, session IDs, frames, DHTML, or Macromedia Flash keep you from seeing your entire site in a text browser, then spiders may have trouble crawling it.
And a more robust list of guidelines is available here: https://support.google.com/webmasters/answer/35769.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does a similar CMS fabric/theme used by 2 colleagues, cause SEO issues?
Does using the same CMS fabric/theme with substantially different content for each website but the same business address (on google places and the websites) cause SEO issues? For example: 2 colleagues with somewhat similar services located at the same business addresses desire to use the same CMS fabric /theme but will have different content on the sites. Will this hurt their SEO / should they use a different website skin/theme?
Web Design | | toti5880 -
Site Rebuild -Larger to smaller
Hi All, We are rebuilding an existing site which has around 230 Pages (lots of content not required) down to around 20. Whats the best way to 301 redirect the pages that are going to be removed- (we wont be able to use .htaccess because we are moving to Adobe Business Catalyst) Thoughts? We are trying to preserve as much SEO value as possible.....
Web Design | | OnlineAssetPartners0 -
Site structure and blog tags for local with five locations
I have a client who has five locations. Their current web site was structured very well for the pre-penguin and Panda world. However it does not seem to do as well after these changes. I believe it would serve them both with their customers as well as on Google if they localized the site for each location. Currently all the content on the site if focused on one location that is in the largest metro. On the content side we have a plan to produce local content and blogs for each location. My questions are how to go about structuring the site map and blogs to provide the most local juice. I was also wondering how to properly mark up a site with a main trunk and five local branches. I am also trying to figure out how to structure the tags on the blog. On the site map itself I was planning on maintaining all the content as well as the older blogs in the main trunk of the web site. Under this trunk there is a locations page that currently goes to five pages that simply have an address as well as a bulletin board of upcoming events. The blog is directly off the main page with no tie to any location. Here are my thoughts on what I think we should do: I believe we should create a mini web site starting at the location page that has specific content and navigation related to each location. That the content should focus on the specifics of that area and what would serve that clientele the best. We should add to each branch location based on the key words and competition in that area. The blog off the main web site should continue to house the general categories that are already there as well as any other general posts. I think we should add a link to each store page with a location specific blog in each mini location site. Each mini location site should have it's own blog with specific blogs targeted towards the local market. This local blog would also feed in the general blogs from the "trunk" as they are posted. Relating back to my original questions: is what I outlined the right approach or is there a more effective way to do this? Is there any special mark up I should do to tell the directories what to do? How do I structure the tags for the blog? I was thinking of a structure like this: General blog/category/subject under the main structure : local blog/category/subject Any ideas of input on this? Ron
Web Design | | Ron_McCabe1 -
Live website is an addon domain - Need site old development url inaccessable from live domain
Hi everyone, I have a website which is built in Joomla 2.5. The development site is located at www,abc.com/subdomain/. We have set the site live using an addon domain which is www.xyz.com. The problem is, www.abc.com/subdomain/ is still accessible and being crawled by Google. How is the best way to make the development url inaccessible? Any help would be appreciated!
Web Design | | DougHosmer0 -
I've set up my own site which is still fairly new but I'm a bit concerned that there is a bloackage SEO wise somewhere because when I try to crawl the site on SEOmoz it only crawls one page.
I'm really baffled and none of my research has shed much light on it. My url is www.emporiumofmanliness.co.uk I'd really appreciate any help! Thanks
Web Design | | JoshED0 -
How does using a CMS (i.e. Wordpress/Drupal) affect backlinks and SEO?
So I need to build a website with over 100 pages in it. Elements of the design will probably be moved around and or tested so I need to use a CMS. It's pretty much a review site so while the content will remain static I'd like to employ A/B testing to mess with conversion rates. Wordpress has a plugin for that even. So I'm just wondering, since CMS pages are pretty much created on spot and not retrieved from a library, how this affects backlinks and anchor text? How exactly does the external website point to yours if the URL is dynamically generated? Or am I misunderstanding something? Please recommend any extra resources as well if you can.
Web Design | | seochump0 -
Mobile Web Sites
Hi I have started offering customers a mobile app view of their existing websites using sencha touch which works well. On visiting the website if a user visits via a mobile device they access the mobile app view of the site. I am looking for some best practice please - as many of the customers already have hosting with their existing website so would it be possible to use a subdomain of m.theirdomain.com which will point to the mobile website which will be hosted on our servers in the cloud. Or is the only alternative to use a subdomain for their mobile sites because they are hosted with us in the cloud of businessname.ourdomain.com ? Many Thanks
Web Design | | ocelot0 -
Does using Wordpress Multisite have any negative SEO impact?
I manage multiple websites in Wordpress and the idea of managing them all under one Wordpress install is very attractive. Are there any dangers SEO-wise to doing so? I know that all of the sites would live under the same IP address, but that's not something I'm really concerned with anyway because I don't do a lot of inter-linking between the sites. Thanks for your help! -El Juano
Web Design | | JonathanFashbaugh0