How to Resolve Google Crawling Issues for My eCommerce Website?
-
I want to resolve Google crawling issues for my eCommerce website. My website is as follow.
http://www.vistastores.com/ Google have crawled only 97 webpages from my website. My website is quite old. (~More than 6 months) But, Google have indexed only 97 webpages.
I have created one campaign over SEOmoz tool and found some errors over there. So, I just assumed that due to it Google did not crawled my website.
But, I have created one another campaign for my competitor website to know actual status and reason behind it.
I found that, my competitor website have more error compare to me but, Google have crawled maximum pages compare to me.
So, What is reason behind it? How can I improve my crawling rate and index maximum webpages to Google?
[6133009604_af85d29730_b.jpg](img src=) 6133009604_af85d29730_b.jpg 6133009604_af85d29730_b.jpg 6139706697_4e252fdb82_b.jpg
-
I aware about it. But, I have confusion with omitted results. Google shows me 509 URLs in visible portion and remaining one in omitted results.
I have checked similar result for my competitor with table lamps keyword.
site:simplytablelamps.com
Google shows 2470 pages for my competitor and omitted result is very less compare to my website.
I really don't know more about it but it may cut out my impression with products which are included in omitted result. This is my assumption. What you think about it? If you can give me more idea so it will help me more.
-
When I do a site:vistastores.com, I see about 2300 results indexed in Google, which indicates Google is both indexing and crawling your site. How many pages do you have?
-
Hi, Liam
I come back on this question after long time. Because, I am still surviving with crawling issue. Google is not crawling my website after implement all checklists.
Today, I read one blog post about to increase Google crawl rate.
Blog suggesting to set custom crawl rate with help of Google webmaster tools. So, Does it really matter to improve crawling?
What is important and helpful ... natural crawling by Google or embarrassing crawling by Google?
-
I am going forward with multiple XML sitemap after long R & D.
-
I am still waiting for additional answers in same direction. Can any one help me? I need answer on urgent basis.
-
Yes, your suggestion is right. I have added XML sitemap to Google webmaster tools. But, I am still confuse with crawling.
-
Not sure if you've already done this, but if not - signup to Google Webmaster Tools and submit your sitemap. You can also check crawl errors etc.
With e-commerce websites it's always useful to use an automated XML sitemap so that each product page is added and can then be crawled and indexed.
Let me know if this answers your question??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirect and Redirect Error in Moz Crawl
Hello, We have a wordpress blog attached to our magento website located at domain.co.uk/blog/ Moz was coming back showing we had multiple page versions on show (http and https) So i updated the htaccess file to what is below. This has fixed most of the errors, however the homepage is being a little tricky. Moz is now saying that the page is redirecting and redirecting again http://www.domain.co.uk/blog to
On-Page Optimization | | ATP
http://www.domain.co.uk/blog/ to
https://www.domain.co.uk/blog/ BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /blog/</ifmodule> RewriteCond %{HTTPS} !=on
RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301] RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /blog/index.php [L] END WordPress Within wordpress settings the urls are set up as follows Wordpress Address URL: https://www.domain.co.uk/blog Site Address URL: https://www.domain.co.uk/blog i tried to add a trailing / to these but it gets automatically removed. So i am assuming that wordpress is serving up https://www.domain.co.uk/blog **RewriteBase /blog/ **is re-directing it to / then my https rewrite is re-directing it again I am not sure where exactly to fix this, could anybody advise? Many thanks,0 -
Google is putting brandname: in title tag
Hello, I was wondering why this is happening? In html for example the title tag is something like this: keyword 1 | keyword 2 | Brand name. Title is 67 characters.. When I search in google, I see the site but it shows brandname: keyword 1 | keyword 2 Is this bad? does this mean that google doesn't like the title tag that is in the html? I tried looking it up on google, but they were outdated and I honestly didn't really see an answer to what it means when this happens. Does the brandname: affect rankings?? Have any of you dealt with this, or noticed this?
On-Page Optimization | | donnieath0 -
Page/Website Structure
Hello again Mozzers, We have a category, lets call it widgets. Within widgets are about a hundred or so products. For usability my predecessor made the following layout Widgets Main Cateogry - Links off homepage - (no content just links to the 3 sub-categories)
On-Page Optimization | | ATP
- Widgets by Resolution
---- About 20 subcategories
eg. 0.1 Resolution widgets
0.2 resolution widgets
- Widgets by Capacity
---- About 20 subcategories
eg. 1 capacity widgets
2 capacity widgets
- Widgets by Type
---- About 12 subcategories This was a major improvement from a userbility perspective as it made a very complex product range navigatable by the major features or basic type. However, as you can imaging we now have 60+ very similiar pages all displaying very similiar products a nightmare for SEO. It also isnt ideal for user navigation as it take too many clicks to get to the products. I propose the following fix, and i wanted your opinion. Widget Main Category - Link from homepage (Consolidated with Widgets by Type)
-300 Words of content
-Links to the 12 Sub-type Catoregies (These are pages i can fill with content + products. This would give me a more ordinary structure of which I can focus each page to a keyword) The tricky part comes with incorporating the capacity and resolution options. 1 Browse Capacity Page
(20 sub categories all the same except capacity quantity & products)
1 Browse by Resolution Page
(20 sub categories all the same except resolution value & products) The owner want them, I was going to link from the main widgets page to each of these to give the customer the option. What I can't decide is how to deal with them from an SEO point of view. Should they be no-followed? canonicaled? Can there be any advantage to having so many pages covering slightly different variations or as i suspect it is dangerous to the overall health of the site. To complicate things further, Canonical tags may not be an option due to an old magento version running that doesnt support them. Is there an alternative way around? As always many thanks.0 -
Google Authorship Problems
Hi, I seem to be having a few problems with getting google authors set up on Wordpress. I've set up my G+ account, put the link to my blog http://appointedd.com/blog/ and then registered it on the yoast plugin. However, I'm not sure it's set up correctly and I can't seem to be able to get it to work. I'm hoping a fine someone here has experience in this as I'm a little flustered. thanks.
On-Page Optimization | | LeahHutcheon0 -
How to mass change Title and Description of a website
Hey , I recently landed a client and his website has a lot of pages. After running a diagnostics in SEOmoz it seems like a lot of them dont have titles and descriptions. Also the ones that have titles and descriptions are not well optimized. I want to change/create titles and descriptions of this website but the problem is it has got 1000s of pages. So I was wondering is there an automated way of doing this? Thanks a lot in advance. Regards
On-Page Optimization | | MerilynL0 -
How to solve Rel Canonical issue?
I have created one campaign for my website on SEOmoz. I found Rel Canonical issue for following 2 URLs. I can not understand that, what is error with that? Can any one help me to solve it? http://vistastores.com/blog/?p=1 http://vistastores.com/blog/?page_id=2
On-Page Optimization | | CommercePundit0 -
Website Content
Is it bad to have html pages on a blog? I converted a completely HTML site to wordpress, but havd hundreds of article pages that are still html.
On-Page Optimization | | azguy0 -
Google place 7 -> 40, why??
Hi, my new site http://www.ie-mac.com/ just dropped 33 places from place 7 to place 40 on goolge.com , for the two word combo: ie mac Did I screw up? How? Background Info: 1 Two weeks ago I moved my whole site from my old domain http://ie4mac.com/ to http://www.ie-mac.com/ with the goal of obtaining a good ranking for the keyword combo: ie mac. Apparantly tis worked- The site showed up on place 7. 2. I changed the design of the site and put the video on the front page. Good so far, still place 7, but: The text that google was showing was half the ALT-Tag of the Video first-slide image and the other half was our trademark disclaimer. 3. I changed the ALT tag and the disclaimer to give users a more inviting text on google. THis worked, google now shows the text as intended, but: For the desired combo: ie mac the site dropped to palce 40!! My best guesses at this point: 1. I'm using wordpress as a CMS and the all-in-one-seo-pack plugin to set custom titles etc., and the google XML sitemap plugin to buid an XML sitemap and notify google. During the couple of days, I made a lot of chnages to the site. Could be that the plugin pinged google a lot of times. Could this be part of the problem? 2. The site is hosted at http://www.ixwebhosting.com/ , because they give users dedicated IPs and a good price. However, the loadlevel on the server I'm on is always very high (10 - 20). I'm using a CDN for images and a caching plugin so the site loads in less than 2 seconds according to http://tools.pingdom.com/ . Unless the cache is empty, then it's 9 seconds. This is not great, but it's also no new, so: What could have caused the sudden drop from 7 to 40?? Thank you and kind regards
On-Page Optimization | | ie4mac0