Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google search result dramatically dropped with drop in DA.
It looks like on 11/13 by site traffic dropped by like 75% and it just happens to coincide with the MOZ DA dropping to. Anyone else see this?
On-Page Optimization | | Motom70 -
Removing navigation menu items/links on homepage
We are redesigning our website after a long stint with an SEO firm who also handled our design/dev. We want to clean up the links on our homepage but don't want to screw up our IA or SEO. We want to delete some navbar menu items and a whole bunch on random links to our evergreen content below the fold. Would we need to reposition those navbar items/content links to our footer or somewhere else on the homepage to maintain our internal linking structure? It would be great if you could take a look at our site and give us any suggestions or advice on the best way to go about this. Thanks!
On-Page Optimization | | Lorne_Marr1 -
Navigational Links in Dropdown Menus
Hi Mozzers will navigational links in dropdown menus carry the same weight for Google, just as navigational links that are always visible to the user do? Thx, Chris
On-Page Optimization | | Diderino0 -
Google Search - One page having problems
this issue is concerning my site - cruvoir.com we retail designer clothing online, and currently have 17 'designer' pages - one for each manufacturer brand name. We target these brand names for our campaign and track the progress with Moz and try to focus them in Google search. Of many of the designer names, we rank pretty well in Google search (usually under #15 when searching for the specific brand. All brands are doing well, except one brand : "Lost And Found" - a designer label we carry. This is the page for this brand name : https://cruvoir.com/5-lost-and-found we cannot figure it out. It happens to be our most important label we carry. when we search for this brand name or include it in any other search terms, we never are in the google search results. I expect it is a crawl issue, but we have covered all our ground in optimizing this brand page. It seems this page is also indexed with Google. But we cannot figure out why it does not rank us in search.
On-Page Optimization | | cruvoir0 -
How to make video snapshot appear near your search result
What's the proper way to have google display a video near the search result for my webpage (I'm using LeadPlayer to play videos). I think that the information regarding the video is there (I also submitted a video sitemap) but when I do a search the author picture is displayed instead of the video. Have I set anything wrong? How can I display the video if my post contains a video? You can try searching "phraseexpander create customizable templates" There's my youtube video and then the result from my webpage http://www.phraseexpander.com I would like to display the video as a result. Thanks a lot. Andrea
On-Page Optimization | | nagar0 -
Search form another country
I am searching from india. what is the way so that i can search as if i am searching from US ? OR UK ?
On-Page Optimization | | seoug_20050 -
Complex navigation structure leaving me puzzled with Meta keywords! Would love some help...
Hi there So I have a main navigation, It includes 5 categories Each category contains 4-6 sub categories Within these sub categories, there are 6 - 10 sub sub categories Its a rather complex navigation but allows the end user to land exactly where they want without much mooching. Now my issue is the use of keywords. Should I be feeding the keywords used in the main category through to the sub category and the sub sub category as they are all linked or should I use unique keywords for each sub/sub/sub category? I have added an image of the nav layout so you can see how it works. I hope that makes sense? Could love some help! dHve8.jpg
On-Page Optimization | | onlineforequine0 -
What's the best practice for implementing a "content disclaimer" that doesn't block search robots?
Our client needs a content disclaimer on their site. This is a simple "If you agree to these rules then click YES if not click NO" and you're pushed back to the home page. I have this gut feeling that this may cause an upset with the search robots. Any advice? R/ John
On-Page Optimization | | TheNorthernOffice790