Why Did My Google Crawls Hit A Wall?
-
Hello,
One my the sites I work with, http://www.oransi.com, has seen a significant decrease in crawl Googlebot activity in the last 90 days. See screenshot.
This decrease in crawl stats runs in conjunction with less Kb downloaded per day & an increase in how much time it took Google to download a page.
The client did just go through a redesign, however that happened on 4/16/15, which was after the decrease in Googlebot activity, so that should not be the issue. Same could be said for the mobilegeddan algorithm change.
Any help would be greatly appreciated.
-
Hi BrandLabs,
Thanks for your question! You've had several community members respond, and they've asked some important questions. Did you see them? Please update, thanks!
Christy
-
Did they recently try and do some 301 redirects to point all non-www pages to the www version? It looks like the redirects may have been setup wrong and they're going to 404 pages instead of redirecting. There are a handful of other broken links on the site as well that could be contributing to the decline in Googlebot crawling. That's where I would start.
-
Well it's clear that something has happened.
Was any work carried out prior to to drop? Are you seeing any increase in 404's or problems in Google Search Console (Webmaster Tools after the daft re-brand)?
-Andy
-
Has there been any changes to website traffic or more specifically organic traffic over this same period?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is my site penalized by Google?
Let's say my website is aaaaa.com and company name is aaaaa Systems. When I search Google aaaaa my site do not come up at all. When I search for "aaaaa Systems" it comes up. But in WMT I see quite a few clicks from aaaaa as keyword. Most of the traffic is brand keywords only. I never received any manual penalty in WMT ever. Is the site penalized or regular algorithm issues?
Intermediate & Advanced SEO | | ajiabs0 -
Crawling issue
Hello, I am working on 3 weeks old new Magento website. On GWT, under index status >advanced, I can only see 1 crawl on the 4th day of launching and I don't see any numbers for indexed or blocked status. | Total indexed | Ever crawled | Blocked by robots | Removed |
Intermediate & Advanced SEO | | sedamiran
| 0 | 1 | 0 | 0 | I can see the traffic on Google Analytic and i can see the website on SERPS when i search for some of the keywords, i can see the links appear on Google but i don't see any numbers on GWT.. As far as I check there is no 'no index' or robot block issue but Google doesn't crawl the website for some reason. Any ideas why i cannot see any numbers for indexed or crawled status on GWT? Thanks Seda | | | | |
| | | | |0 -
Google Places Drop
Hi everyone! I have a client that was ranking very nicely for a number of keywords. In the 5 pack for most of the keywords we were targeting. His account went under review for some unknown reason about 2 months ago. It disappeared from the listing... Then a few weeks ago it became approved again. He is now no longer ranking for any of those keywords. He is ranking for some obscure ones but the money words are gone. Do you think this was due to the review? Some sort of GP update over the last 60 days? All of my other clients are still ranking strong in Google Places. Any ideas?
Intermediate & Advanced SEO | | SeattleJoe0 -
Google Business Places SEO Question
Hi All, I have set up different Google Business Places listings for each of my locations for my business. I want each location to rank for their retrospective keywords. So from an SEO point of view to help these rank.. When choosing Keywords/Categories for my listing , should I use my main keyword + my location example - I have a carpet cleaner hire depot in London and I want to rank for London so should my keyword be just carpet cleaner hire or Carpet Cleaner Hire London. My other depot is say in the location of Watford so should that listing have keywords that contain Watford in them ?. Also - Should the description contain my localised keywords ? I have looked around and cant' find much on this topic Any pointers would be greatly appreciated thanks Sarah
Intermediate & Advanced SEO | | SarahCollins0 -
Am I buying links according to Google?
I have the opportunity to sponsor a variety of sections in a variety of .edu sites. Really appealing since they will both provide high quality traffic as well as to help our rankings... (maybe 🙂 )... Anyway this opportunity involves a monetary exchange, no different than advertising in Adwords and/or buying a display ad with the NYT. The links will be both text and banner... With follow links. My questions to you guys are: Is this practice penalize? And will display ads pass link juice also? Thanks for the help...
Intermediate & Advanced SEO | | dhidalgo10 -
Google places
Is there away to get to the top of google places? Can it be manipulated?
Intermediate & Advanced SEO | | dynamic080 -
Google Penalty, Which one is hitting me?
Hello there SEOMOZ'ers, Just signed up for a Pro Account. Impressed with the trial. Just wondering is there any way to find out if you have fallen foul of a Google update, is there any way to know which you have fallen foul of or is the date it happens the only guide or pointer to what might have happened? My site was getting a reasonable amount of traffic for the last few years and was ranking well for my main search terms up till Feburary the 4th when the traffic fell by almost 50% ... and it has never really recovered. I thought it might be the Above the Fold Advertising penalty (or whatever it is called) because I had a lot of images linking elsewhere on my site, above the fold on my homepage, but I removed them about 4 weeks ago and the traffic still hasnt recovered. I've been using SEOMOZ to detect duplicate content and various other problems with my site since and fixing a good few of them each week. I have the main issues down from about 300 to about 20 which i think i have just fixed. I have also used Copyscape and found that some other websites had stolen some of my content, which i have since rewritten. I was ranking number 2 or 3 for my main keyword but dropped out of the top 100 in February, which is pretty frustrating at this stage. I don;t know if I have accidentally gone too far over optimising my site or what has happened. If anyone can give me some pointers I'd really appreciate it, if anyone can help me fix it I'll buy them a beer next time you are in Ireland! 🙂 Thanks, Shane
Intermediate & Advanced SEO | | shaneod0