Navigation for Users vs Spiders
-
We're creating a new global site nav that provides a great user experience, but may be less than ideal for the search engines. The user selects an item from category A, and is then presented options to choose from in category B, and then chooses a specific product. The user does not encounter any actual "links" until they choose the specific product.
The search engines won't see this navigation path due to the way that the navigation is coded. They're unable to choose an item from A, so they can't get to B, and therefore cannot get to C, which is the actual product page.
We'd like to create an alternative nav for the browsers, so that they can crawl the category pages for A and B, as well as the specific product pages (C).
This alternative nav would be displayed if the user does not have javascript enabled. Otherwise, the navigation described above will be shown to the user.
Moving forward, the navigation that the user sees may be different from what is shown to the search engine, based on user preferences (ie they may only see some of the categories in the nav, while the search engines will see links to all category/product pages).
I know that, as a general rule, it's important that the search engines see the same thing that the user sees. Does the strategy outlined above put us at risk for penalties?
-
Here is the Google’s guidelines for developers that how they can make their AJAX code crawlable.... https://support.google.com/webmasters/answer/174992?hl=en
I guess you should pretty much focus on your user’s experience and I believe Google crawlers can easy crawls your AJAX and JS codes...
Hope this helps!
-
Same response AJAX is a javascript method to get content from another page. Crawlers have no issues indexing that. Now a days, most BIG sites use AJAX, like the ones with infinite scroll.
The way they do it is: they put the link to the next page (that users don't see since you hide the "Next" via css) and both crawlers and users can navigate the site just fine. In your case, you can put links into each submenu option too, that way you will help both users and crawlers.
-
Sorry, I should have clarified, the navigation utilized AJAX, so the links don't actually appear anywhere in the source. We do have breadcrumbs on the product pages. Thanks!
-
Search engines are already good executing Javascript, so they WILL see those links too. I would suggest only the "user" navigation and add some bread crumbs in each product (the path the user followed to reach that product) so crawler and users can also navigate the site by category.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEMrush vs GA rankings drop since February and December 2018?
I am wondering if someone can help me understand what's going on with our site. We had a 50% drop in the number of keywords ranking from February 2018 to October in SEMrush. Looking at SEMrush, I am actually seeing a drop after 2/208 with many competitor's sites as well. We saw moderate improvement in November, but around December 6th, we started seeing a decline the number of keywords ranking again. In Google Analytics, there was a 10-15% drop in traffic after February 2018, which recovered September to December, but since early December, there is a drop again. In GWT, I am seeing something similar to analytics with impressions and clicks. We have done some SEO the past couple of years, but we have taken care to do things white-hat so as not to incur a penalty. We have also invested in writing content for our blog on a regular basis. Any thoughts?
White Hat / Black Hat SEO | | kekepeche0 -
Link Building vs. Straight Earning Links Discussion
Hello, I'd like to start a discussion on link building outreach techniques vs. just building a good website with good 10X content. I don't like to receive unsolicited emails in my inbox, so why should the people in my industry? Also, I've seen plenty of evidence of 10X content soaring without link building outreach. But link building isn't dead of course, so can you tell me your personal experiences either way and the ethics of what you do? I especially want to hear if you've had luck with just building good websites and being successful based on the content itself, but an open discussion of either side is welcome. Leaning towards just building good websites and letting the Google algo do it's thing. Would love to hear your experiences either way. Thanks.
White Hat / Black Hat SEO | | BobGW3 -
I show different versions of the same page to the crawlers and users, but do not want to do anymore
Hello, While Google could not read JavaScript, I created two versions of the same page, one of them is for human and another is for Google. Now I do not want to serve different content to the search engine. But, I am worry if I will lose my traffic value. What is the best way to succeed it without loss? Can you help me?
White Hat / Black Hat SEO | | kipra0 -
Question about "sneaky" vs. non-sneaky redirects?
One of my client's biggest keyword competitors is using, what I believe to be, sneaky redirects. The company is a large, international corporation that has a local office. They use a totally unrelated domain name for local press and advertising, but there is no website. The anchor text in the backlinks automatically redirects to the corporate website. Is this sneaky or not?
White Hat / Black Hat SEO | | JCon7110 -
Real Vs. Virtual Directory Question
Hi everyone. Thanks in advance for the assistance. We are reformatting the URL structure of our very content rich website (thousands of pages) into a cleaner stovepipe model. So our pages will have a URL structure something like http://oursite.com/topic-name/category-name/subcategory-name/title.html etc. My question is… is there any additional benefit to having the path /topic-name/category-name/subcategory-name/title.html literally exist on our server as a real directory? Our plan was to just use HTACCESS to point that URL to a single script that parses the URL structure and makes the page appropriately. Do search engine spiders know the difference between these two models and prefer one over the other? From our standpoint, managing a single HTACCESS file and a handful of page building scripts would be infinitely easier than a huge, complicated directory structure of real files. And while this makes sense to us, the HTACCESS model wouldn't be considered some kind of black hat scheme, would it? Thank you again for the help and looking forward to your thoughts!
White Hat / Black Hat SEO | | ClayPotCreative0 -
Would reviews being served to a search engine user agent through a noscript tag (but not shown for other user types) be considered cloaking?
This one is tough, and I've asked it once here, http://www.quora.com/Search-Engine-Optimization-SEO/Is-having-rich-snippets-placed-below-a-review-that-is-pulled-via-javascript-considered-bad-grey-hat-SEO, but I feel that the response was sided with the company. As an SEO or digital marketer, it seems that if we are pulling in our reviews via iframe for our users, but serving them through a nonscript tag when the user agent is a search engine, that this could be considered cloaking. I understand that the "intent" may be to show the same thing to the bots as the user sees, but if you look at the view source, you'll never see the reviews, because it would only be delivered to the search engine bot. What do you think?
White Hat / Black Hat SEO | | eTundra0 -
Google places VS position one ranking above the places.
Hi Guys, Will creating a new Google places listing for a business have any effect their current position one spot for their major geo location keyword? I.e restaurants perth - say they are ranking no 1 above all the places listings if they set up a places listing would they lose that position and merge with all the other places accounts? Or would they have that listing as well as the places listing? I have been advised it could be detrimental to set up the places account if this is the case does anyone know any ways around this issue as the business really needs a places page for google maps etc. Appreciate some guidance Thanks. BC
White Hat / Black Hat SEO | | Bodie0 -
Links In Blog Posts: 1 Paragraph VS. Full Article
Hey guys, I've been using an article network to post unique articles (not spun). Been posting 1 paragraph articles with 1 text link. Just wondering what the main difference would be if I were to post a full article with 2 or 3 text links vs 1 paragraph with 1 text link, besides the fact that you get more links and save more time writing only 1 paragraph. Will the full article with 3 backlinks improve keyword ranks more or not by much? Cheers!
White Hat / Black Hat SEO | | upick-1623910