Google not crawling the website from 22nd October
-
Hi, This is Suresh. I made changes to my website and I see that google is unable to crawl my website from 22nd October. Even it is not showing any content when I use Cache:www.vonexpy.com. Can any body help me in knowing why Google is unable to crawl my website. Is there any technical issue with the website? Website is www.vonexpy.com
Thanks in advance.
-
Looks like its not just us - this is starting to get more attention https://www.seroundtable.com/google-cache-dated-19497.html
-
Our home page was cached today, but many of the pages on our site haven't been indexed since late October. It looks like this is a widespread issue.
-
I can see 90% of the pages I look at havent been cached since 22nd Oct, and I mean pages picked at random from hotels.com, booking.com and other big sites - is there a wider google cache issue going on?
-
I understand but we are not talking about black hat seo, just to crawl a site that hasn´t be crawled since october. And we all already know that sometimes Google says half-truths. I was suggesting to do something knew to get different results that he already had. Anyway i appreciate your point of view.
-
Google the queries: black hat seo, link buying. Click the first 100 results for both + read the guide on SEO by Google and then you probably get the point ;-).
-
Why not Martijn? That tool has helped me several times not in the same case but for backlinks.
-
You are not being serious?
-
Thanks Martin,
I made some design changes to my website. When you check the cache you an see that the website content is not crawled as the website contains some java script links. I replaced them with text links. So now it should crawl and index the website even though there is no new content. As the old spider is unable to crawl the website because of the image based links. And also I submitted the sitemap to webmaster tools only after the design change. It just indexed all the 30 urls 2 days back.@ Hemani I already submitted to webmaster tools and used fetch as google on the site but still there is no crawling.
-
Hi Suresh,
It looks like there are no problems on the site itself that prevent Google from crawling it, so that's a good thing. As the sitemap only consists of 31 (different) URLs, chances are that Google found out that the pages aren't any different any time that they crawled the pages. If that is really the case then I wouldn't mind so much about Google not crawling the content every now and then.
-
This is a normal problem and I have accord this quite a few times on my blog. The best way to do that is to submit your sitemap in Google Webmaster tool and get social tweets and social likes on your website and you will see Google will start crawling your website in days!
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Sites website https://www.opcfitness.com/ title NOT GOOD FOR SEO
We set up a website https://www.opcfitness.com/home on google sites. but google sites page title not good for SEO. How to fix it?
Technical SEO | | ahislop5740 -
Home Pages of Several Websites are disappearing / reappearing in Google Index
Hi, I periodically use the Google site command to confirm that our client's websites are fully indexed. Over the past few months I have noticed a very strange phenomenon which is happening for a small subset of our client's websites... basically the home page keeps disappearing and reappearing in the Google index every few days. This is isolated to a few of our client's websites and I have also noticed that it is happening for some of our client's competitor's websites (over which we have absolutely no control). In the past I have been led to believe that the absence of the home page in the index could imply a penalty of some sort. This does not seem to be the case since these sites continue to rank the same in various Google searches regardless of whether or not the home page is listed in the index. Below are some examples of sites of our clients where the home page is currently not indexed - although they may be indexed by the time you read this and try it yourself. Note that most of our clients are in Canada. My questions are: 1. has anyone else experienced/noticed this? 2. any thoughts on whether this could imply some sort of penalty? or could it just be a bug in Google? 3. does Google offer a way to report stuff like this? Note that we have been building websites for over 10 years so we have long been aware of issues like www vs. non-www, canonicalization, and meta content="noindex" (been there done that in 2005). I could be wrong but I do not believe that the site would keep disappearing and reappearing if something like this was the issue. Please feel free to scrutinize the home pages to see if I have overlooked something obvious - I AM getting old. site:dietrichlaw.ca - this site has continually ranked in the top 3 for [kitchener personal injury lawyers] for many years. site:burntucker.com - since we took over this site last year it has moved up to page 1 for [ottawa personal injury lawyers] site:bolandhowe.com - #1 for [aurora personal injury lawyers] site:imranlaw.ca - continually ranked in the top 3 for [mississauga immigration lawyers]. site:canadaenergy.ca - ranks #3 for [ontario hydro plans] Thanks in advance! Jim Donovan, President www.wethinksolutions.com
Technical SEO | | wethink0 -
Page disappeared from Google index. Google cache shows page is being redirected.
My URL is: http://shop.nordstrom.com/c/converse Hi. The week before last, my top Converse page went missing from the Google index. When I "fetch as Googlebot" I am able to get the page and "submit" it to the index. I have done this several times and still cannot get the page to show up. When I look at the Google cache of the page, it comes up with a different page. http://webcache.googleusercontent.com/search?q=cache:http://shop.nordstrom.com/c/converse shows: http://shop.nordstrom.com/c/pop-in-olivia-kim Back story: As far as I know we have never redirected the Converse page to the Pop-In page. However the reverse may be true. We ran a Converse based Pop-In campaign but that used the Converse page and not the regular Pop-In page. Though the page comes back with a 200 status, it looks like Google thinks the page is being redirected. We were ranking #4 for "converse" - monthly searches = 550,000. My SEO traffic for the page has tanked since it has gone missing. Any help would be much appreciated. Stephan
Technical SEO | | shop.nordstrom0 -
Hosting Multiple Websites
I want host multiple websites in geo-specific locations, and also have them be unique from each other. Does anyone have suggestions of a software or another method to use for this? Any experience with http://multiplecloud.com?
Technical SEO | | theLotter0 -
How to rank in Google Places
Normally, I don't have a problem with local SEO (more of a multi-channel sort of online marketing guy) but this one has got me scratching my head. Look at https://www.google.co.uk/search?q=wedding+venues+in+essex Theres two websites there (fennes and quendon park) that both have a much more powerful DA but don't appear in the Google Places (Google + Business or whatever it's labeled as). Why are websites such as Boreham house ranking top in the map listings? Quendon Park has a Google places listing, it's full of content, the NAP all matches up. Its a stronger website. Boreham House isn't any closer to the centroid than Quendon Park Just got me struggling this one
Technical SEO | | jasonwdexter0 -
Question for experts - a website is ranking defying all google rules
Hi all Today I saw a strange result in google's search page. When I typed a keyword: Rezeptfrei bestellen, it gave me results like number 1- http://www.rezeptfreibestellen.com/ If I check this site in opensiteexplorer, this is nothing but a new site with no backlinks, or any other offpage work. Onpage work is simply keyword stuffing and domain name is also same as keyword. Now why google ranked this website above others? Where are google EMD and Penguin, Panda? Amit
Technical SEO | | expertvillagemedia1 -
Linklicious and Crawl rates
Can somebody please explain me what is 'crawl rate' and how does 'linklicious' help us with it? I mean I can always visit the website and know more about it, but I want to understand the concept. Please help.
Technical SEO | | KS__0 -
I have 15,000 pages. How do I have the Google bot crawl all the pages?
I have 15,000 pages. How do I have the Google bot crawl all the pages? My site is 7 years old. But there are only about 3,500 pages being crawled.
Technical SEO | | Ishimoto0