How do we get search engine bots to the item detail pages?
-
The problem we have is that we have lots of inventory pages. These inventory pages have a bunch of links at the top linking to different styles of the item, up to 56 links in some cases. Then each item listed has a link to the item's detail page and a link to the item's shop owner's page. So if a page has 50 items shown, there are really 100 links just for the inventory. This is not taking into account the header links, footer links, sidebar links to other sections on the site.
We have all these links to help consumers move through the site. The problem is that every item detail page on the site is not getting indexed and actually I think it's more like over 50% of the item detail pages are not indexed because the search engines are too busy following all these other links.
Should we nofollow, index the links to the different styles of the item, the shop owner page? Or what should we do to get the search engine bots to index our item detail pages?
-
CFSSEO,
Can you share the site so we can have a look at it to provide a better, more specific, answer for you? If not, I hope this general answer will help:
You should only have one canonical page per product. Even if there are product variants (size, color, etc...) those should typically be handled with a drop-down selector or checkbox on the product page instead of creating an entire new product page for each variant.
If this is a large affiliate or drop-shipping website where you are pulling in feeds from different merchants/distributors/stores the bitter pill you may have to swallow is that such sites are dying out in the SERPs because Google doesn't think they offer anything above and beyond their own search results. Someone wants to buy a Blue Widget and they go to Google and type "Cheap blue widget" and a bunch of merchants'/distributors' stores show up... why do they need to put another site in-between the searcher and their destination? The only way to work within this paradigm is to prune the site down and focus mostly on category-level searches, price comparison searches, etc... and by offering more useful features, including robust customer reviews for products and merchants, tools to help the shopper compare options, in-depth buying guides to educate shoppers on their choices... but thousands of product pages with default manufacturer content will no longer do the trick, and may actually harm the rest of your site.
This may or may not apply to your situation. It is tough to give advise like this without knowing the site in question. However, I hope it has helped point you in the right direction.
-
I'm worried the search engines are not indexing all the item detail pages due to too many links at the top of the inventory pages. There are so many options of itemA that there are 50 links about different types of itemA at the top of the page, then 50 items are shown with a link to the item detail page and a link to the 'shop' of that seller. Along with a search box on the page. And there could be hundreds of these items but default of 50 shown on a page. So there's well over 100 links on a page, and I'm worried the bots aren't finding all the item detail pages.
-
You have to reduce the number of pages that Google "sees" when you are showing search result pages. If you have too many sort versions on a given query, you are giving Google a bunch of duplicate (or closely duplicate) pages to spider and it prevents them from getting down into your item detail page.
I would find a way to setup a main / generic pagination result so that Google can spider that and then as they go through each page, they find links into the products. All the other versions of your search results, I would no follow links to them or put them in a folder that you can robots.txt.
This way consumers can search and sort to their hearts desire, but you provide a clear path for Google.
Also, be sure to setup a XML sitemap and include links to all of your item detail pages. You can also split out into multiple sitemaps if you have large enough number of item detail pages. A good article on this is here
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Index Page Redirect to Home Page? Best Practices...
Hi, I am wondering what the best practice is when a site has an index page and a home page? I have two pages, listed below, and want to know if I should 301 redirect my "index" page to my standard home page. The home page is where I would like all traffic to fall on for our website. Additionally, I used the rel=canonical tag years ago on the index page to indicate that the home page is the main content. Home Page - https://www.1099pro.com/ (PA 45) Home Page Canonical: rel="canonical" href="https://www.1099pro.com/"/> Index Page - https://www.1099pro.com/index.asp (PA - 33) Index Page Canonical: rel="canonical" href="https://www.1099pro.com/"/> It seems to me that there is some extra juice that could be passed to my home page (which is the page that ranks highly for our major keywords) by 301 redirecting the index page. Is there any reason why I should not do that? Really appreciate any help - especially with extra explanations - for the simple minded like me ;)! -Michael
Web Design | | Stew2220 -
Google Search Console Block
Am new to SEO. My clients site was completed using Yoast premium and then used Google search console to initiate the crawl. Initially setup an http:// property and all seemed good. Then i removed that under search console an created an https:// did the render and it appears google has put a block and placed their own robots.txt file which basically has rendered the site useless. Feedback most appreciated.
Web Design | | BoostMyBiz0 -
Is having a site map page necessary?
Hello all! So I know having a sitemap XML file is important to include in your robots.txt file. I also know it is important to submit your XML sitemap to Google and Bing. However, I am wondering if it is beneficial for your site's SEO value to have a sitemap page displayed on your website? Or is this just a redundant action if you have already done the above two actions with your XML sitemap? Thanks in advance!
Web Design | | Myles920 -
Pushstate and Infinite Scrolling Article Pages: Is it detrimental to not change URLs as the page is being scrolled?
I've noticed a recent trend of news sites using infinite scrolling on article pages to garner more pageviews and I can assume serve up more ads. Here is an overview. Here is an article from NBC news that uses this technique: http://www.nbcnews.com/pop-culture/music/grammys-2016-here-s-why-adele-s-performance-was-out-n519186 Studies have shown that this technique has decreased bounce rates by +15% for some sites. My question is: If a site is using the technique without changing URLs as the user scrolls down what overall negative effects does this have? Obviously you wouldn't be getting credit for the extra pageviews but I was wondering if there were any indexation implications with this. Here is an example of article infinite scrolling without changing the URL: http://www.wftv.com/news/national-content/deputies-wife-attacks-husband-because-he-didnt-get-her-a-valentines-day-gift/87691927
Web Design | | Cox-Media-Group1 -
Responsive design to serve different page for IE8 - SEO Implications?
A client is planning on developing a responsive designed website which redirects visitors using IE8 to a static webpage that encourages users to visit in another browser. What are the SEO implications of a server redirect just for IE8 visitors? Possible solutions: would containing a link on the static page to "continue browsing" and give the visitor access to the entire site in IE8 work well? Or should a CSS overlay message appear to IE8 visitors, no redirect, that encourages them to visit in another browser? Or serving a separate stylesheet for IE8 visitors, and not giving a responsive experience be optimal? Any suggestions or thoughts are appreciated. Cheers, Alex
Web Design | | Alex.Weintraub0 -
Content Migration & cost of moving pages
Hope you are all having a great day! I am wondering if anyone would be able to provide general feedback. I work for a medium size company in Chicago. Currently our site is static html and we are seeking to migrate to Wordpress. After speaking with a number of website companies and receiving proposals, I am trying to understand if there is an approximate going rate or range for moving content from static html to a CMS like Wordpress? i.e. a cost per page? We don't have any dynamic content. Most of our pages are text and images. The site itself, including the blog is around 220 pages. Thanks in advance for any insight or resources!
Web Design | | SEOSponge0 -
Location specific services pages
Hi guys, I'm working with a client who would has offices in two cities in Australia, and they provide a certain service to both cities. They would like to rank for keyword phrase for the service for both cities. E.g. Window Cleaning Brisbane, Window Cleaning Darwin. I strongly believe in focusing on relevance and visitor experience first, rather than ham-fistedly trying to rank for those phrases. Having said that, I'm thinking of creating two pages for those phrases as a sub-page to the service itself, with the title of those pages containing the geographically specific phrases. E.g.: Window Cleaning -->Window Cleaning Brisbane -->Window Cleaning Darwin The pages would highlight the 'reach' of the service in the two cities, as well as some specific information such as the history of both offices, any distinctions between the services provided, the teams at both locations, and so forth. I feel that although this seems like a valid reason for doing this, I may be overlooking something. What do you guys think?
Web Design | | carlod0 -
Do pages with low PA effect DA?
I was looking into raising my firm's Domain Authority and I had a thought. I was wondering if our very low PA pages are bringing the overall DA down? Our homepage is at 43 currently and the DA is 32. We have quite a few pages and I am trimming a little fat in the deep pages currently. I was wondering what would be the result in terms of DA I am also starting an aggressive initiative to blog more and try to attract links through guest posting and HARO (Hep A Reporter Out). I understand that many people will say DA is not a metric your should necessarily build around. But, while I am fighting for rankings in a very competitive vertical, I assume a higher DA is better, no? From everything I have read on Moz over the years, they say that the DA metric is the one that tries to encompass a multitude of factors, similar to the way something more complex like the Google algorithm does. So, I assumed finding small gains in DA could be beneficial to the site's rankings and traffic I tried to go into detail and get specific here because I know how many bad questions are asked daily. Thanks anyone and everyone for the help, I do thoroughly appreciate the Moz community
Web Design | | BossArrighi0