Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why the url inspection is disabled in search console ?
In this situation, how can we make our pages be fetched by google?
On-Page Optimization | | supporthandle0 -
Category Pages are not Shown when searched for "brandname Category name"
Hi, Someone googled our brand name + category page name and our category page didn't showed up first so he says it's a bad job/thing. so help me to fix this. Googled "sepalika acid reflux" without quotes. Thank you.
On-Page Optimization | | Sepalika0 -
Directories and Search Engine Site Submissions and Technorati Tags Important?
I use a wordpress for out website 50campfires.com and we have a site map set up along with google analytics and web master tools. I believe wordpress automatically sends information to the search engines with changes in the site map. Do I need to submit to search engines manually once a month? Is directories like DMOZ still relevant with SEO today? And what are your opinions on Technorati Tags? I never heard of them before reading this article. I m new to SEO and any insights are helpful. 2Sqv5C2.png EEQFpIx.png 2Sqv5C2.png
On-Page Optimization | | revonick1 -
Please give me advice on how to get this page back into search engines
Hi. Before we had our site www.in2town.co.uk upgraded, we had this section on the first page of google and even though it does not badly with other search engines, with google we are not in the top fifty. the page is http://www.in2town.co.uk/gastric-band-hypnotherapy i would be so grateful for advice on how to get this section back into google i am also concerned that i have a category called gastric band hypnotherapy, what i mean is, http://www.in2town.co.uk/gastric-band-hypnotherapy/crash-diets-can-damage-your-health-says-gastric-band-hypnosis-expert as you can see from above, we have the category name which is gastric band hypnotherapy and then the article name, just wondering if this is damaging us. any help to sort our ranking issue our would be amazing
On-Page Optimization | | ClaireH-1848860 -
If Google still shows my old title in the search results then there is no way my title change could have changed my ranking yet right?
If Google still shows my old title in the search results then there is no way my title change could have changed my ranking yet right? In other words if I changed from TItleA to TitleB but search results and cache still show TitleA then any SERP drops or increases would still be entirely based on titleA right? Thanks.
On-Page Optimization | | Rezo0 -
How could I avoid the "Duplicate Page Content" issue on the search result pages of a webshop site?
My webshop site was just crawled by Roger, and it found 683 "Duplicate Page Content" issues. Most of them are result pages of different product searches, that are not really identical, but very similar to each other. Do I have to worry about this? If yes, how could I make the search result pages different? IS there any solution for this? Thanks: Zoltan
On-Page Optimization | | csajbokz0 -
What's the best practice for implementing a "content disclaimer" that doesn't block search robots?
Our client needs a content disclaimer on their site. This is a simple "If you agree to these rules then click YES if not click NO" and you're pushed back to the home page. I have this gut feeling that this may cause an upset with the search robots. Any advice? R/ John
On-Page Optimization | | TheNorthernOffice790 -
Shall Google index a search result?
Hi, I've a website with about 1000 articles.Each article has one ore more keywords / tags. So I display these keywords at the article page and put a link to the intern search engine. (Like a tag cloud) The search engine lists als articles with the same keyword and creates a result page. This result page is indexed by Google. The search result contains the title of the article, a short description (150-300 chars.) and a link to the article. So, Google believes, that there are about 5.000 pages instead of 1.000 because auf the link to the search result pages. The old rule was for me: More pages in Google = better. But is this still true nowadays? Would be a "noindex, follow" better on these search result pages? (Is there a way to tell Google that this is a search result page?) Best wishes, Georg.
On-Page Optimization | | GeorgFranz0