Adding Millions of Products to Google
-
What is the best way to submit all of your product pages, millions, to Google for serps? XML, RSS, Google Product Search, etc.
These are products that are updated on a daily basis, and change often.
-
When you say 'submit all of your product pages' - Do you mean submit them to Google's organic search engine, or Google Shopping?
For the organic search engine, depending on how many pages you really have, I would say you should submit xml sitemaps, and you may need to submit a sitemap index too (check the current max. limit on a single sitemap submission, I am not sure what it is these days!).
Personally though, with a good navigation system and a few backlinks, you shouldn't need to worry 'too much' about submitting xml sitemaps.
As you say the product pages are updated daily though, I can see why you feel the need to do this.
Or, did you mean submitting them to...
If you have lots of products, I would strongly recommend submitting them to Google Shopping - it's free, after all!
This should help you to get some 'quick wins' whilst you work at getting your products and category pages ranking well in the organic results.
**Canonicalisation **
As you are running an ecom. store, with lots of products - be very careful with canonical and duplication issues, especially since Google Panda! Ensure that query strings in your URLs don't result in multiple URLs for the same products, likewise make sure if you have products in multiple categories, that you are not creating duplicate content/URLs that way either! - I guess you have this covered already?
-
I would mark them up as a product using http://schema.org/
Then simply putting the main catagory pages in your site map will be fine. Search engines will find them. Bing for one has said not to put every page in a sitemap as they will just start tio ignore your sitemap. just the important pages.
This is assuming you do have a good linking stucture so that they can be found.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Seeing 301 as 404
Hi all, We recently migrated a few small sites into one larger site and generally we had no problems. We read a lot of blogs before hand, 301'd the old links etc and we've been keeping an eye on any 404s. What we have found is that Webmaster is picking up quite a few 404s, yet when we investigate these 404s they are 301'd and work fine. This isn't for every url, but Google is finding more and I just want to catch any problems before they get out of hand. Is there any reason why Google would count a 301 as a 404? Thanks!
Intermediate & Advanced SEO | | HB170 -
Google not displaying meta description
Hi, one of my clients is receiving the following error in SERP - "A description of the page is not available because of this site's robots.txt". The site is built on WordPress and I realized that by default, the settings were checked to blocks bots from crawling the site. So, I turned it off, fixed robots.txt and submitted the sitemap again. Since, then it's been almost 10 days, the problem still exists. Can anyone tell me what should be done to fix it or if there's a way to get Google to recrawl the pages again.
Intermediate & Advanced SEO | | mayanksaxena0 -
Product Syndication and duplicate content
Hi, It's a duplicate content question. We sell products (vacation rental homes) on a number of websites as well as our own. Generally, these affiliate sites have a higher domain authority and much more traffic than our site. The product content (text, images, and often availability and rates) is pulled by our affiliates into their websites daily and is exactly the same as the content on our site, not including their page structure. We receive enquiries by email and any links from their domains to ours are nofollow. For example, all of the listing text on mysite.com/listing_id is identical to my-first-affiliate-site.com/listing_id and my-second-affiliate-site.com/listing_id. Does this count as duplicate content and, if so, can anyone suggest a strategy to make the best of the situation? Thanks
Intermediate & Advanced SEO | | McCaldin0 -
ECommerce Google PR mystery
Dear all, Our eCommerce site has the following structure Home .. PR=5 Category .. PR=4 (linked from home) Sub-Category Linked from Category PR=Un-ranked The domain has several years and perform well the site is here: http://tinyurl.com/5v9hrql Any idea or suggestion? Thank you Claudio
Intermediate & Advanced SEO | | SharewarePros0 -
Are links that are disavowed with Google Webmaster Tools removed from the Google Webmaster Profile for the domain?
Hi, Two part question - First, are links that you disavow using google webmaster tools ever removed from the webmaster tools account profile ? Second, when you upload a file to disavow links they ask if you'd like to replace the previously uploaded file. Does that mean if you don't replace the file with a new file that contains the previously uploaded urls those urls are no longer considered disavowed? So, should we download the previous disavow file first then append the new disavow urls to the file before uploading or should we just upload a new file that contains only the new disavow urls? Thanks
Intermediate & Advanced SEO | | bgs0 -
Does Google read code as is or as rendered?
Question - Does Google read code as is or as rendered? So for example, with a Facebook Like box, it has all the profile pictures of people...will Google see these as all separate links or ignore them?
Intermediate & Advanced SEO | | jhinchcliffe0 -
Effect of I-Frame on Google Rank
My commercial real estate web site (www.nyc-officespace-leader.com) allows visitors to search for office space listings. The site sources listings through a third party and they are displayed in an i-frame. The i-frame directs visitors to listing pages such as: http://listings.nyc-officespace-leader.com/getspace.mpl?sp_id=A0173921&cust_id=offspldr Atleast 10,000 of these pages have backlinks to my site. My question is the following: Could these tens of thoudands of alpha numeric URLs be detrimental to my sites ranking on Google after the Panda/Penguin updates? SIte traffic dropped from 7,000 per month to about 3,300 after the April Google update. Rewriting content for dozens of pages and adding a blog have only somewhat mitigated the negative effects of Panda/Penguin. Could Google be viewing these links from the third party lisitng provider as a negative when they viewed these links as a plus before? Any downside to removing the third party links and parsing these listings from landlord websited and displaying them as part of my site with their own URL, title tag, description tag? Obviously the new URLS would not be alphanumeric. If these links have not caused the drop in traffic last April, what could be responsible? Thanks in advance for your opinion!!! Alan
Intermediate & Advanced SEO | | Kingalan10 -
Does Google index url with hashtags?
We are setting up some Jquery tabs in a page that will produce the same url with hashtags. For example: index.php#aboutus, index.php#ourguarantee, etc. We don't want that content to be crawled as we'd like to prevent duplicate content. Does Google normally crawl such urls or does it just ignore them? Thanks in advance.
Intermediate & Advanced SEO | | seoppc20120
