Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Branded keyword results meta description is different then long tail branded search term in SERP
Search "Venturize", the first result is Venturize with the
On-Page Optimization | | WWWade
description "Get help on finding the right loan for your small business
and learn what to look for when comparing your options." However, if you Google "Venturize opportunity finance network", the
first result is Venturize with the description "Playing:360p@30. Embed
size: CDN:fastly. Open link. Twitter · Facebook · About Venturize ·
Contact · About OFN · Mission-Driven Lenders: Locator Map." Why is Google not taking the meta description in the longer tail search? I have checked: All of google's indexed pages for the website- A 3rd party crawl of the website- Multiple other keyword combinations Nothing produced the same result or indicated a reason why "Venturize opportunity finance network" has the incorrect meta description in the SERP.any ideas?0 -
Google is showing product rating of 1-star in search results when average rating is 3.7 - 4 stars
When searching for the brand name "SteriPEN", the #3 listing on the SERP is for one of SteriPEN's "Adventurer Opti" product at REI.com, On the SERP for this search, the REI listing for Adventurer Opti product displays showing the product as 1-star based on a product review from 2010. What we don't understand is the fact that the product history has a 3.7 to 4.2 rating on most websites. Why would a product with so many reviews and established history have 1 review that drives the 1-star rating from such a prominent retailer? Makes no sense. Any suggestions as to whom we might be able to contact for help with this is greatly appreciated. edit?usp=sharing
On-Page Optimization | | ReachMaineAgency0 -
Search by popular terms
This may be a simple question and possibly already answered to death - but I think i'm not asking or googling the right question so I haven't been able to get a good answer for it. Some websites have a feature at the bottom of their page where one can "search by popular terms", consisting of keywords linked to the search result of that term. Some websites do this: http://www.kogan.com/au/search-terms/ This must be obviously an optimisation technique, but how does this benefit ranking? Are there any down sides to this? Is this still a current good practice?
On-Page Optimization | | central60 -
Do Navigation links count the main link on the page?
After reading this article http://www.seomoz.org/learn-seo/anchor-text it talks about how only one link per page counts if they are going to the same page. This is what i had learned in the past; however, my understanding was if it was a in the main navigation as a child or grandchild or in the side navigation and then in the main body text, the link in the main body would count/ be held higher than the other options.
On-Page Optimization | | DoRM0 -
Does the positioning of the text on a webpage matter for search engines?
Does the positioning of the text on a webpage matter for search engines? Do you need to place the text at the upperside of a webpage or is at the bottom also a good option?
On-Page Optimization | | HMK-NL0 -
ON SITE SEARCH INDEXED BY GOOGLE - no follow or no index
Google indexes alll our internetal searches: search box is brand - clothes types - size type - and for each page it creates a page that which creates duplicate page title and unnecessary content. Should I do a nofollow on the advance search or a no index. Many thanks for the info. Sonja
On-Page Optimization | | reallyitsme0 -
Filtered Navigation, Duplicate content issue on an Ecommerce Website
I have navigation that allows for multiple levels of filtering. What is the best way to prevent the search engine from seeing this duplicate content? Is it a big deal nowadays? I've read many articles and I'm not entirely clear on the solution. For example. You have a page that lists 12 products out of 100: companyname.com/productcategory/page1.htm And then you filter these products: companyname.com/productcategory/filters/page1.htm The filtered page may or may not contain items from the original page, but does contain items that are in the unfiltered navigation pages. How do you help the search engine determine where it should crawl and index the page that contains these products? I can't use rel=canonical, because the exact set of products on the filtered page may not be on any other unfiltered pages. What about robots.txt to block all the filtered pages? Will that also stop pagerank from flowing? What about the meta noindex tag on the filitered pages? I have also considered removing filters entirely, but I'm not sure if sacrificing usability is worth it in order to remove duplicate content. I've read a bunch of blogs and articles, seen the whiteboard special on faceted navigation, but I'm still not clear on how to deal with this issue.
On-Page Optimization | | 13375auc30