Navigation for search
-
We are getting ready to launch a site that has great navigation for users, but it is not so great for search engines. As long as we are ethical about it, does anyone see a downside to detecting a bot user agent and displaying different nav to it? I suppose some could consider it cloaking, but I noticed amazon uses this strategy and they don't seem to be getting a big penalty lol. We are not going to do anything shady with it, just offer the bot a different way to access our content. Any thoughts?
-
I would never recommend altering your site in any way specifically for a bot. Google has repeatedly stated that would be seen as cloaking and you definitely run the risk of a penalty. It can happen any time. Do you really want that cloud over your head?
Even if Amazon is able to do it, you are not Amazon. Despite any statement to the contrary, a huge site like Amazon can do things that you or I may not be able to do. We can debate the fairness of it, but we are not on a level playing field with them.
You seem to really want to do this, so feel free. But x months from now you will likely make a post "My rankings dropped and I can't figure out why", and then someone will notice the setting and that will be the answer.
-
Could you please share the site in question? we might be able to give a much more insightful thought
-
Thanks for your suggestion Alex!
-
All the content will be accessible through the sitemap which will be displayed in both versions (the user and the bot) version of the site. The only difference is the navigation will change from one version to another. It could be perceived as a gray area, even though we really are just making it more friendly to bots not trying to be deceptive at all.
-
And that should be okay if they see the content is the same between your normal version and the spider version, just a difference in presentation. It becomes a problem when you start serving drastically different content.
-
How about adding an indexable version of the navigation and then hiding it with CSS? The crawlers would see that. I haven't thought about whether that'd be a good idea, just a quick thought.
-
We usually operate under the principal that would this be ok if it were manually reviewed? In our plan, I am pretty confident that it would pass. We are planning on making what is displayed to bots very basic text link navigation. Our XML and html sitemaps will correspond well with the bot navigation (so to show G we really are not trying to hide anything). And yes we could make the nav more search friendly, but one of our main goals is to have the site look as clean as possible. As far as I can tell Amazon uses this method to avoid duplicate content issues and make their site generally more crawlable which is why I think it is on the table as an option.
-
Depending on how much you're changing, I think it could be considered cloaking and end up getting you in trouble. You'll get looked at any time you're sniffing for bots and serving up different content. Are there other ways you could make the navigation index-able?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Review snippets not shown on google search results
Hi, In Moz it shows that we have a review snippet for a keyword/page, but it is not shown on google SERP. Can anyone explain why it isnt shown on Google search results, and what we should do in order to get it shown ?
On-Page Optimization | | jensatlieto0 -
Long-tail with few searches vs. Generic with many
Our business is a contract packager/manufacturer of products sold to very prominent brands who sell through retail. For example, we make the sunscreen under a brand’s name, which you might then find on the shelf in Target or CVS. As I’ve optimized our pages, I’ve attempted to go long-tail, which has been simply to add “…contract packaging” or a variation after the particular product. So, instead of trying to compete in “sunscreen”, which would pit me against big-box distributors and prominent brands and sellers of sunscreen, I’ve optimized for “sunscreen manufacturers.” “Sunscreen” has 31K – 72K searches, with an 81 Difficulty and 67 Potential. “Sunscreen manufacturers” has a low 13 Difficulty and a decent 54 Potential, but only 51 – 100 searches. Some of my terms have only 0 – 10 searches, but I’ve been thinking that it’s better to compete for fewer but more qualified / buyer-intent searches and have generally lower Difficulty. Can you please tell me if this is a smart strategy, or if I should instead try to compete in higher-volume terms but much greater Difficulty? Thanks a lot for everyone's help.
On-Page Optimization | | Beau_W0 -
Your tactics on improving organic search for a site in a struggling industry
We work with a client of ours with organic search initiatives. The problem is: the industry (e.g. the core of the business) is sagging. It has been for a couple of years. And they're finally feeling these sagging losses. Google Trends support this and shows it quite nicely. It pretty much mirrors organic search referrals as well. The industry (e.g. the core phrase that the company and its competitors have historically hit very hard) as well as Google Trends for the client (middle of the pack) and their two big competitors are attached. Wondering if anyone else has had this type of circumstance with their clients and some of their go to tactics that helped them stop the skid (and even make it start going up). Thanks SpztkvF.png LPHGo76.png
On-Page Optimization | | ChristianMKG0 -
Removing navigation menu items/links on homepage
We are redesigning our website after a long stint with an SEO firm who also handled our design/dev. We want to clean up the links on our homepage but don't want to screw up our IA or SEO. We want to delete some navbar menu items and a whole bunch on random links to our evergreen content below the fold. Would we need to reposition those navbar items/content links to our footer or somewhere else on the homepage to maintain our internal linking structure? It would be great if you could take a look at our site and give us any suggestions or advice on the best way to go about this. Thanks!
On-Page Optimization | | Lorne_Marr1 -
Search by popular terms
This may be a simple question and possibly already answered to death - but I think i'm not asking or googling the right question so I haven't been able to get a good answer for it. Some websites have a feature at the bottom of their page where one can "search by popular terms", consisting of keywords linked to the search result of that term. Some websites do this: http://www.kogan.com/au/search-terms/ This must be obviously an optimisation technique, but how does this benefit ranking? Are there any down sides to this? Is this still a current good practice?
On-Page Optimization | | central60 -
Hi can anyone help me with navigating through my business admin page? having a little trouble. Many Thanks
It looks like this... The person that created it has put the term "Hand painted ceramics from spain - inspired ceramica" on every page title and i cant find where it is to delete it. If anyone can help that will be a real help. Many Thanks, Robbie oOU4YDY
On-Page Optimization | | allenr120 -
Navigation Links Causing Too Many Links Help?
Hello, I have read some SEOMOZ search results for this, but am still concerned that Google may see 4,500 Too Many Link warnings as a problem. This is caused primarily due to our header navigation, which is not intended to be keyword stuffing, but to provide all avenues for our breadth of content. site: crazymikesapps.com. Most answers seem to advise if there is no keyword stuffing at hand don't worry about it. Any help appreciated. thank you Mike
On-Page Optimization | | crazymikesapps0 -
Title Tag Not Relaying In Google Search
Our title tag is "<title>HCG</span> Diet - HCG Drops - Example Weight Loss - HCG Diet Weight Loss</title>" But in google it is only displaying "HCG diet" Reasons? What can I do to fix this? I'm trying to get this fixed asap, as it is our homepage that is being effected by it.
On-Page Optimization | | HCGDiet0