How do we get search engine bots to the item detail pages?
-
The problem we have is that we have lots of inventory pages. These inventory pages have a bunch of links at the top linking to different styles of the item, up to 56 links in some cases. Then each item listed has a link to the item's detail page and a link to the item's shop owner's page. So if a page has 50 items shown, there are really 100 links just for the inventory. This is not taking into account the header links, footer links, sidebar links to other sections on the site.
We have all these links to help consumers move through the site. The problem is that every item detail page on the site is not getting indexed and actually I think it's more like over 50% of the item detail pages are not indexed because the search engines are too busy following all these other links.
Should we nofollow, index the links to the different styles of the item, the shop owner page? Or what should we do to get the search engine bots to index our item detail pages?
-
CFSSEO,
Can you share the site so we can have a look at it to provide a better, more specific, answer for you? If not, I hope this general answer will help:
You should only have one canonical page per product. Even if there are product variants (size, color, etc...) those should typically be handled with a drop-down selector or checkbox on the product page instead of creating an entire new product page for each variant.
If this is a large affiliate or drop-shipping website where you are pulling in feeds from different merchants/distributors/stores the bitter pill you may have to swallow is that such sites are dying out in the SERPs because Google doesn't think they offer anything above and beyond their own search results. Someone wants to buy a Blue Widget and they go to Google and type "Cheap blue widget" and a bunch of merchants'/distributors' stores show up... why do they need to put another site in-between the searcher and their destination? The only way to work within this paradigm is to prune the site down and focus mostly on category-level searches, price comparison searches, etc... and by offering more useful features, including robust customer reviews for products and merchants, tools to help the shopper compare options, in-depth buying guides to educate shoppers on their choices... but thousands of product pages with default manufacturer content will no longer do the trick, and may actually harm the rest of your site.
This may or may not apply to your situation. It is tough to give advise like this without knowing the site in question. However, I hope it has helped point you in the right direction.
-
I'm worried the search engines are not indexing all the item detail pages due to too many links at the top of the inventory pages. There are so many options of itemA that there are 50 links about different types of itemA at the top of the page, then 50 items are shown with a link to the item detail page and a link to the 'shop' of that seller. Along with a search box on the page. And there could be hundreds of these items but default of 50 shown on a page. So there's well over 100 links on a page, and I'm worried the bots aren't finding all the item detail pages.
-
You have to reduce the number of pages that Google "sees" when you are showing search result pages. If you have too many sort versions on a given query, you are giving Google a bunch of duplicate (or closely duplicate) pages to spider and it prevents them from getting down into your item detail page.
I would find a way to setup a main / generic pagination result so that Google can spider that and then as they go through each page, they find links into the products. All the other versions of your search results, I would no follow links to them or put them in a folder that you can robots.txt.
This way consumers can search and sort to their hearts desire, but you provide a clear path for Google.
Also, be sure to setup a XML sitemap and include links to all of your item detail pages. You can also split out into multiple sitemaps if you have large enough number of item detail pages. A good article on this is here
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Index Page Redirect to Home Page? Best Practices...
Hi, I am wondering what the best practice is when a site has an index page and a home page? I have two pages, listed below, and want to know if I should 301 redirect my "index" page to my standard home page. The home page is where I would like all traffic to fall on for our website. Additionally, I used the rel=canonical tag years ago on the index page to indicate that the home page is the main content. Home Page - https://www.1099pro.com/ (PA 45) Home Page Canonical: rel="canonical" href="https://www.1099pro.com/"/> Index Page - https://www.1099pro.com/index.asp (PA - 33) Index Page Canonical: rel="canonical" href="https://www.1099pro.com/"/> It seems to me that there is some extra juice that could be passed to my home page (which is the page that ranks highly for our major keywords) by 301 redirecting the index page. Is there any reason why I should not do that? Really appreciate any help - especially with extra explanations - for the simple minded like me ;)! -Michael
Web Design | | Stew2220 -
We redesigned our website, make it responsive and page views tanked. What happened?
Last year, we redesigned our site and made it responsive. Our page views only grew by only 3% (the previous year they grew by 40%). If we exclude homepage views from our calculations, we get a drastically different picture-- and see over 30% growth for both total and unique pageviews. Any thoughts?
Web Design | | Anna720 -
In Wordpress getting marked as duplicate content for tags
Moz is marking 11 high priority items for duplicate content. Just switched to wordpress and publishing articles for the site but only have a few. The problem is on the tag pages. Since there aren't very many articles so when you go to the tag pages it lists one or two articles and hence there are pages with duplicate content. Most of the articles have the same tags / categories. Perhaps I'm using too many tags and categories? I'm using about 7 tags and around 2 categories for each post / event. I've read the solution is using canonical tags but a little confused on which page I should use for the tag and then I believe I need to point the duplicate pages to the correct page. For example, I have two events that are for dances and both have the same tags. So when you visit, site.com/tags/dance or site.com/events both pages have the same articles listed. Which page do I select as having the original content? Does it matter? Does that make sense? Someone was also saying I could use the Yoast plugin to fix, but not really seeing anything in the Yoast tools. I also see 301 redirects mentioned as a solution but the tag pages will be changing as we add new articles and they have a purpose so not really seeing that as a solution.
Web Design | | limited70 -
Spaces at beginning of title tag - negatively affect the optimization of the page?
For some reason, our title tags have a long space after the beginning title tag and before the text appears. The beginning title tag is on one line, then a break, a tab and then the content of the title tag. I'm pretty sure this is not good and is affecting optimization of the page. Am I correct or is this not an issue and does not need to be fixed? Example: | <title></span></p> <p> </p> </td> </tr> <tr> <td class="line-number"> </td> <td class="line-content"> First keyword</td> </tr> </tbody> </table></title> |
Web Design | | CFSSEO0 -
Duplicate page title caused by Shopify CMS
Hi, We have an ecommerce site set up at devlinsonline.com.au using Shopify and the MOZ crawl is returning a huge number (hundreds!) of Duplicate Page Title errors. The issue seems to be the way that Shopify uses tagging to sort products. So, using the 'Riedel' collection as an example, the urls devlinsonline.com.au/collections/riedel-glasses/ devlinsonline.com.au/collections/riedel-glasses/decanters devlinsonline.com.au/collections/riedel-glasses/vinum all have the exact same page title. We are also having the same issue with the blog and other sections of our site. Is this something that is actually a serious issue or, perhaps, is Google's algorithm intelligent enough to recognise that this is part of Shopify's layout so it will not negatively affect our rankings and can, essentially, be ignored? Thanks.
Web Design | | SimonDevlin0 -
What is the best tool to view your page as Googlebot?
Our site was done with asp.net and a lot of scripting. I want to see what Google can see and what it can't. What is the best tool that duplicates Googlebot? I have found several but they seem old or inaccurate.
Web Design | | EcommerceSite0 -
So apparently SEO moz will get us de-indexed according to a SEO company!
Each and every day i get called up from an SEO company who promises to get me top spots in Google rankings if i quickly get on their special offer they have today normally i would say "no thanks and put the phone down" but i had a bit of spare time so i indulged the guy and we got talking. After the introductions and speal about his company he was showing me what his company does and how they go about it to get me top ranks (they don't get me ranks but create a website they own which then passes leads to me- kinda clever since they could then start charging me per lead or my competitors) We continued to talk and i mentioned i used SEOmoz to check my rankings and back links etc and he told me that Google are cracking down and anyone using these types of software/websites will get their websites de indexed. This struck me as BS but i wanted to get your thoughts on the matter, i personally don't believe Google would ever do such a thing as this since it would be so easy to get your competitors websites taken down (i.e. negative seo) but its certainly a talking point.
Web Design | | GarethEJones0 -
How do you get rid of the .html and .php extensions at the end of urls?
What is the whitehat way to properly remove the .html and .php extensions at the end of urls? Example: http://www.seomoz.org/learn-seo.php should be (and is) http://www.seomoz.org/learn-seo
Web Design | | Ryan-Bradley0