Why Did My Google Crawls Hit A Wall?
-
Hello,
One my the sites I work with, http://www.oransi.com, has seen a significant decrease in crawl Googlebot activity in the last 90 days. See screenshot.
This decrease in crawl stats runs in conjunction with less Kb downloaded per day & an increase in how much time it took Google to download a page.
The client did just go through a redesign, however that happened on 4/16/15, which was after the decrease in Googlebot activity, so that should not be the issue. Same could be said for the mobilegeddan algorithm change.
Any help would be greatly appreciated.
-
Hi BrandLabs,
Thanks for your question! You've had several community members respond, and they've asked some important questions. Did you see them? Please update, thanks!
Christy
-
Did they recently try and do some 301 redirects to point all non-www pages to the www version? It looks like the redirects may have been setup wrong and they're going to 404 pages instead of redirecting. There are a handful of other broken links on the site as well that could be contributing to the decline in Googlebot crawling. That's where I would start.
-
Well it's clear that something has happened.
Was any work carried out prior to to drop? Are you seeing any increase in 404's or problems in Google Search Console (Webmaster Tools after the daft re-brand)?
-Andy
-
Has there been any changes to website traffic or more specifically organic traffic over this same period?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I have never seen this in Google SERPs before?
What is this that I am seeing in the Google SERPs? It's a bank of 3 separate articles from one site, but they are grouped together like an organic listing. Checkout the link to see what I'm talking about http://imgur.com/xbUk1NG
Intermediate & Advanced SEO | | MJTrevens0 -
Website not coming up properly on Google
Hello, our website (http://www.roguevalleymicro.com/index.php) is not coming up properly on Google search (for example, when you search for Rogue Valley Microdevices on Google). We believe that there is something wrong with the website source code, and Google cannot index it properly. However, your Crawl Test results did not indicate any such problems. Can someone help us with some advice please?
Intermediate & Advanced SEO | | medved441 -
April Google Update?
Since April 16 (when Jews ate Matzah) Google hurt one of our clients badly. They are well-known and beloved brand with hundreds of employees and locations across USA.
Intermediate & Advanced SEO | | Elchanan
I can’t see any signal of organic update, or penalty (neither Google Places). No message on GWT Nothing has been changed on and off site. All keywords' ranking are looking like this All tools showing good analysis: MOZ, Barracuda, MajesticSeo Content is good and not duplicated, etc. Do one of you is aware of significant Google update?
What do you think/suggest?0 -
Hit hard on Google last October.
Hi all, I'm just wondering if anyone is able to help me with why my website lost practically all its ranking last October (2012). My website is here: http://bit.ly/nAOfNj Since early 2010, we have been ranking in the top 3 for our keyword when searched all around the country. Between end September, and end October 2012, we started dropping (from 2nd to 8th, then in December, 13th, January, 18th place... and then March back up to 13th, now ~10th). The main problem seems to be that Google has changed how websites rank for our keyword (trampoline). In Brisbane, Australia (where we are based), we only rank in the local organic searches. We don't have a separate listing there anymore (with the meta description), even though we had a normal organic listing (and local listing) for the last 2 years! When searching from other states/suburbs further away, we dropped way off the first page. Our product is sold by resellers in 400 stores around Australia, so its not like we're just in Brisbane. Has anyone experienced Google changing how they return results for a specific keyword like this? Did they do it a lot towards the end of last year? We have a place page for Brisbane, but for some reason I have little to no control over it (Places/Local+ stuff up means I can't manage the page on Local+, can't add pictures/videos etc). My boss suggested we even try deleting the maps page or our local+ page to get out of there. We don't get anywhere near as much traffic through the local listing than a normal listing... I'm not sure if that's best though? From what I can tell, the only Google algorithm updates that may have affected us at the time (October 9th) were the page layout updates that penalised(?) sites that have a lot of "ads" above the fold. Our website is designed to have splash banners on the top of every page to either promote our own product, competitions or the athletes we sponsor. Up until last week, the banners were always 500px high on larger screen desktops and 300px high on smaller desktops, laptops, ipad etc. I have recently changed them to all be 300px high to test, but I imagine i'll have to wait a while? Is this the kind of content that Google means by "ads above the fold"? I've spent the last 4 weeks working on our SEO, from HTML validation, to rich snippets, content optimisation, a lot more internal linking, setting up some location-based content, doing a lot of keyword research, and now starting to work on cleaning up our Blog and creating some real sharable content that we'll share on our Facebook. I really just wish I knew where the problem was so I could tackle that 😞 Any advice would be GREATLY appreciated!!
Intermediate & Advanced SEO | | Vuly0 -
Google disavow tool
I have an algorithmic penalty on one of my websites. I never received a notification of a manual penalty in GWMT and even sent in a reconsideration request 6 months ago ad they told me their were no manual penalties on the website. I have cleaned up my link profile and what I could not clean up I sent in using the Google disavow tool a few days ago. I've heard to just wait if it's algorithmic or should I send in another reconsideration request for disavow links tool?
Intermediate & Advanced SEO | | MarkHIggins0 -
What is the value of Google Crawling Dynamic URLS with NO SEO
Hi All I am Working on travel site for client where there are 1000's of product listing pages that are dynamically created. These pages are not SEO optimised and are just lists of products with no content other than the product details. There are no meta tags for title and description on the listings pages. You then click Find Out more to go to the full product details. There is no way to SEO these Dynamic pages This main product details has no content other than details and now meta tags. To help increase my google rankings for the rest of the site which is search optimised would it be better to block google from indexing these pages. Are these pages hurting my ability to improve rankings if my SEO of the content pages has been done to a good level with good unique Titles, descriptions and useful content thanks In advance John
Intermediate & Advanced SEO | | ingageseo0 -
How can Google index a page that it can't crawl completely?
I recently posted a question regarding a product page that appeared to have no content. [http://www.seomoz.org/q/why-is-ose-showing-now-data-for-this-url] What puzzles me is that this page got indexed anyway. Was it indexed based on Google knowing that there was once content on the page? Was it indexed based on the trust level of our root domain? What are your thoughts? I'm asking not only because I don't know the answer, but because I know the argument is going to be made that if Google indexed the page then it must have been crawlable...therefore we didn't really have a crawlability problem. Why Google index a page it can't crawl?
Intermediate & Advanced SEO | | danatanseo0 -
Google places
Is there away to get to the top of google places? Can it be manipulated?
Intermediate & Advanced SEO | | dynamic080