Why Did My Google Crawls Hit A Wall?
-
Hello,
One my the sites I work with, http://www.oransi.com, has seen a significant decrease in crawl Googlebot activity in the last 90 days. See screenshot.
This decrease in crawl stats runs in conjunction with less Kb downloaded per day & an increase in how much time it took Google to download a page.
The client did just go through a redesign, however that happened on 4/16/15, which was after the decrease in Googlebot activity, so that should not be the issue. Same could be said for the mobilegeddan algorithm change.
Any help would be greatly appreciated.
-
Hi BrandLabs,
Thanks for your question! You've had several community members respond, and they've asked some important questions. Did you see them? Please update, thanks!
Christy
-
Did they recently try and do some 301 redirects to point all non-www pages to the www version? It looks like the redirects may have been setup wrong and they're going to 404 pages instead of redirecting. There are a handful of other broken links on the site as well that could be contributing to the decline in Googlebot crawling. That's where I would start.
-
Well it's clear that something has happened.
Was any work carried out prior to to drop? Are you seeing any increase in 404's or problems in Google Search Console (Webmaster Tools after the daft re-brand)?
-Andy
-
Has there been any changes to website traffic or more specifically organic traffic over this same period?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Missing Google verification
I just went to check my client sites in Google search console and noticed a whole bunch of them no longer 'verified'. They were all previously verified. Why would they suddenly change status to 'not verified'? Does this affect anything (eg. search analytics data flowing through to GA)? Does this mean I have to verify all over again?
Intermediate & Advanced SEO | | muzzmoz0 -
Google de-indexed a page on my site
I have a site which is around 9 months old. For most search terms we rank fine (including top 3 rankings for competitive terms). Recently one of our pages has been fluctuating wildly in the rankings and has now disappeared altogether from the rankings for over 1 week. As a test I added a similar page to one of my other sites and it ranks fine. I've checked webmaster tools and there is nothing of note there. I'm not really sure what to do at this stage. Any advice would me much appreciated!
Intermediate & Advanced SEO | | deelo5550 -
Website Structured data in Google
Can anyone help me to show website structure data in Google when someone search my website in Google. I already added my website in Google and Google webmaster tool. Thanks in adv.
Intermediate & Advanced SEO | | talkinnetventure0 -
Huge Google Dance For Some Rankings. What Gives?
I've got a relatively new website (launched at the beginning of June 2013). For some keywords I'm targeting, it first ranked around page 15. It made huge jumps to finally rank on page 2 or 3. Since then, it goes back to page 15 and then back to page 3. It does this every now and then. Any ideas?
Intermediate & Advanced SEO | | sbrault740 -
Buying a domain banned by google
Hi , I came across a super domain for my business but found out that it was a great domain with 100s of link backs but is now banned by Google search engine meaning Google does not index content from that domain. Since the domains linkbacks are from my domin does it make sense to but that domain and redirect those link backs to another (301) and hope that the new domain gets some juice ... I know it is sounding crazy and may not be the best thing to do ethically but still wanted to check if its possible to get some juice.. Rgds Avinash
Intermediate & Advanced SEO | | Avinashmb0 -
Google Crawl Rate and Cached version - not updated yet :(
Hi, Ive noticed that Google is not recognizing/crawling the latest changes on pages in my site - last update when viewing Cached version in Google Results is over 2 months ago. So, do I Fetch as Googlebot to force an update? Or do I remove the page's cached version in GWT remove urls? Thanks, B
Intermediate & Advanced SEO | | bjs20100 -
Why is google showing our blog like this?
Why is our blog title saying "the blog" before it in Google? X4vTU.png
Intermediate & Advanced SEO | | Tatango0 -
Google Previews highlighting Promotions?
I came across this today when doing a Google search - a site that has a small promo code listed on their page shows a preview with that promo highlighted...I dug around their code a little bit, but couldn't find if it was something they were doing to manipulate their preview in the search results. Is Google automatically highlighting promotions in previews, or did getmarried.com/magazine/ somehow manipulate the page to make their promo highlighted? And if so, how? You can see the site at http://www.getmarried.com/magazine/ and you can see the preview with the promo highlighted attached. ZDY52.png
Intermediate & Advanced SEO | | klars5240