How to Resolve Google Crawling Issues for My eCommerce Website?
-
I want to resolve Google crawling issues for my eCommerce website. My website is as follow.
http://www.vistastores.com/ Google have crawled only 97 webpages from my website. My website is quite old. (~More than 6 months) But, Google have indexed only 97 webpages.
I have created one campaign over SEOmoz tool and found some errors over there. So, I just assumed that due to it Google did not crawled my website.
But, I have created one another campaign for my competitor website to know actual status and reason behind it.
I found that, my competitor website have more error compare to me but, Google have crawled maximum pages compare to me.
So, What is reason behind it? How can I improve my crawling rate and index maximum webpages to Google?
[6133009604_af85d29730_b.jpg](img src=) 6133009604_af85d29730_b.jpg 6133009604_af85d29730_b.jpg 6139706697_4e252fdb82_b.jpg
-
I aware about it. But, I have confusion with omitted results. Google shows me 509 URLs in visible portion and remaining one in omitted results.
I have checked similar result for my competitor with table lamps keyword.
site:simplytablelamps.com
Google shows 2470 pages for my competitor and omitted result is very less compare to my website.
I really don't know more about it but it may cut out my impression with products which are included in omitted result. This is my assumption. What you think about it? If you can give me more idea so it will help me more.
-
When I do a site:vistastores.com, I see about 2300 results indexed in Google, which indicates Google is both indexing and crawling your site. How many pages do you have?
-
Hi, Liam
I come back on this question after long time. Because, I am still surviving with crawling issue. Google is not crawling my website after implement all checklists.
Today, I read one blog post about to increase Google crawl rate.
Blog suggesting to set custom crawl rate with help of Google webmaster tools. So, Does it really matter to improve crawling?
What is important and helpful ... natural crawling by Google or embarrassing crawling by Google?
-
I am going forward with multiple XML sitemap after long R & D.
-
I am still waiting for additional answers in same direction. Can any one help me? I need answer on urgent basis.
-
Yes, your suggestion is right. I have added XML sitemap to Google webmaster tools. But, I am still confuse with crawling.
-
Not sure if you've already done this, but if not - signup to Google Webmaster Tools and submit your sitemap. You can also check crawl errors etc.
With e-commerce websites it's always useful to use an automated XML sitemap so that each product page is added and can then be crawled and indexed.
Let me know if this answers your question??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
"Google-selected canonical different to user-declared" - issues
Hi Moz! We are having issues on a number of our international sites where Google is choosing our page 2 of a category as the canonical over page 1. Example; https://www.yoursclothing.de/kleider-grosse-groessen (Image attached). We currently use infinite loading, however when javascript is disabled we have a text link to page 2 which is done via a query string of '?filter=true&view=X&categoryid=X&page=2' Page 2 is blocked via robots.txt and has a canonical pointing at page 1. Due to Google selecting page 2 as the canonical, the page is no longer ranking. For the main keyphrase a subcategory page is ranking poorly. LqDO0qr
On-Page Optimization | | RemarkableAgency1 -
Language redirction causing 302 issues
Hi, I am getting an error on Moz campaign for 302 errors. The reason we have this redirection is because we have the website available in different languages and the website redirects to the language according to the area you are in. e.g. www.keyhub.com/en or www.keyhub.com/es I am guessing it might be a common issue for all the websites with multiple languages. Any solutions for this or should we just ignore this error? Thanks, Priyam
On-Page Optimization | | kh-priyam0 -
Is there a benefit to hiding words from Google on ecommerce sites?
I think we all know that ecommerce sites have a lot of repeating functional texts on them. Is there a benefit from hiding this text from Google's crawler? Take this page for example, http://storage3.static.itmages.com/i/16/0805/h_1470425505_1090542_224cc344d4.png Some of the most dense words on the page are "Add to cart", "Add to Wishlist", "New", and "Sale". Is there any benefit to hiding those words from Google? The method of hiding I am talking about is not cloaking, but this, https://www.google.com/support/enterprise/static/gsa/docs/admin/70/gsa_doc_set/admin_crawl/preparing.html#1076243 using the google:off index tag. So the content will be there still, but it will not be indexed.
On-Page Optimization | | LesleyPaone0 -
Page Rank Lost After Website Transfer
Hello, I recently transferred a website from Ruby on Rails to Wordpress in order to help with the site's responsiveness. I kept all of the URLs the exact same, but when I transferred it only the homepage and one other page kept their page ranks, all of the others have lost theirs completely. Almost every page on the site was at least a PR 2, and now their not ranked, and not ranking in the top of search engines like they were before. I am not quite sure what might have caused this, like I said, I kept the URLs all the exact same and its strange that 2 pages were not effected. I crawled the site with Screaming From and all of the pages that lost their page rank have a status as "Moved Permanently". They are the exact same URL, but they are listed without www. in front, could this have something to do with it? The website is www.goenergylink.com, and you will see that the homepage and "Residential" page still have their page rank, but none of the others do. Any help would be GREATLY appreciated! Thanks
On-Page Optimization | | mcmckenna10 -
Title Tag issue
Hello, This is a weird one. I am hoping someone can point me in the right direction. A couple months ago, we updated trinitypower.com and it was back then that I first noticed this issue, but because the home page title tag was okay and contained the primary terms for that page, I told myself I would circle back. The problem is that even though Google crawls the site everyday, it does not update the title tag text in it's index. Google: "Trinity Power Rentals" and you will see the title in the index as "Trinity Power: Temporary Power Rentals". Go to trinitypower.com and view source. You will see the title tag in the code as "Temporary Power Rentals - Trinity Power" The desc tag has been updated correctly, but I can't figure out why not the Title tag. You can look at the cache version in the index of Google. It is showing the latest version of that tag, so I really do not understand what has happened here. I am using WP Super Cache... maybe a conflict with that? I have dumped it's cache numerous times though. Please let me know what you think. Thanks, Jarrett
On-Page Optimization | | TrinityPower0 -
DMCA Complaint to Google
I have several sites copying the content from my pages. I filed numerous complaints with Google and checked under the DMCA dashboard and it's showing my requests are approved; however, still several days later the infringing pages still remain. I'm a bit confused by this as I thought Google was supposed to remove the page. I guess I'm not understand why it was "approved" when I don't see changes. Am I supposed to contact the site's owner to get the pages down now? I don't want to show duplicate content to my site. Please help!
On-Page Optimization | | tutugirl0 -
What are the best eCommerce sites from an SEO perspective?
We're working hard on improving our website right now, and would love to get the community's examples of the best eCommerce sites out there, from an SEO and a general customer-centric design perspective...
On-Page Optimization | | reddogmusic0 -
How to avoid content duplication of my websites
Hello, We are having 4 domains abc.com, abc.in, abc.co.uk, abc.com.au with same content and same inner pages (abc.com/page1, abc.in/page1 etc.) targeting on different geographical areas. How can we avoid duplicate content issue in the home page as well as in the inner pages. Abc.com is the major site. Thank you.
On-Page Optimization | | semvibe0