A Serious drop in Pages crawled per day
-
On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.
Here is my website url - http://www.wpstuffs.com/
-
What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles. What changed round about then that would have caused an increase in load times?
If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare. Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added? Pingdom tools is also great for picking apart load times.
That would be where I'd start...
-
Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.
Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.
Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.
-
Yes, well there are a couple of things to consider and test.
First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.
Have you changed platforms?
If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My website is not configured in AMP pages, but it is mobile-friendly.
Hi
Algorithm Updates | | rayabahadur
My website is not configured in AMP pages, but it is mobile-friendly.
Last month, my website was ranked to 10 positions for this keyword (Magento Development Company).
Sometimes it's showing on 25 positions but not in the top 5 positions. Here is my URL (for analysis):
https://www.nevinainfotech.com/magento-development-service/
Would you please explain why my keyword rankings are often not showing in the search listings?
Would you mind letting me know is there anything I need to change?
Thank0 -
Doorway Algorithm Update Affecting Location Based Pages?
Hi all, I read this article concerning the doorway algorithm update - http://searchengineland.com/google-to-launch-new-doorway-page-penalty-algorithm-216974 This quote is what got my attention: "How do you know if your web pages are classified as a “doorway page?” Google said asked yourself these questions: Is the purpose to optimize for search engines and funnel visitors into the actual usable or relevant portion of your site, or are they an integral part of your site’s user experience? Are the pages intended to rank on generic terms yet the content presented on the page is very specific? Do the pages duplicate useful aggregations of items (locations, products, etc.) that already exist on the site for the purpose of capturing more search traffic? Are these pages made solely for drawing affiliate traffic and sending users along without creating unique value in content or functionality? Do these pages exist as an “island?” Are they difficult or impossible to navigate to from other parts of your site? Are links to such pages from other pages within the site or network of sites created just for search engines?" We utilize location based pages for ourselves and a few clients too. **Example Case: ** -We attempt to rank for "keyword city/state" - "keyword city/state" - "keyword city/state" The keywords will often be the same such as "AC Repair" or "Physical Therapy" etc. with city / state combination such as "Tulsa, OK" "Seattle, WA" etc. The goal is to rank locally for those terms (NAP is applicable in some circumstances). Does the above case classify as a Doorway page? According to that definition, it does. However, this is a business that services that area. Some don't have physical address there but they do service that area (whether it be AC Repair or Website Design). Please advise me as to what a doorway page is exactly & if my practice is in-line. Thanks, Cole
Algorithm Updates | | ColeLusby0 -
Rankings Drop Week Beginning 19 May
Hi All I have experienced quite a significant rankings drop since week commencing 19 May. I have heard there has been a Panda roll out recently was it around that time? Thanks Gavin
Algorithm Updates | | gavinr0 -
Does Google Analytics Adjusted Bounce Rate Lead to Increase in Average Time per Visitor?
Hello, I just recently implemented adjusted bounce rate onto one of the websites that I track via google analytics. (http://searchenginewatch.com/article/2322974/How-to-Implement-Adjusted-Bounce-Rate-ABR-via-Google-Tag-Manager-Tutorial) Since doing so, obviously my bounce rate has gone down significantly, nearly half of what it use to be, but I've also noticed an increase in the average time per visitor. In fact, the increase of average time per visitor began the same day I adjusted the bounce rate. Has this happened to anyone else? Can someone please explain why/how this may occur?
Algorithm Updates | | WebServiceConsulting.com0 -
Google Rankings Dropped in Past Few Weeks
Hi All, I work for an online appliance retailer and over the past weeks, we've seen a drop in our google SERPs. This time last year we were ranking in the top 3 for our top converting key terms, but now we are ranking towards the bottom of the first page or even on the top of the second page with the big box stores now dominating for our key terms. Needless to say traffic for these pages has dropped off considerably. We still have quite a bit of traffic coming in for other key terms, but they don't convert as well. Is anyone else seeing the same thing? If so what are you doing to combat this? Do you have any suggestions? Thank you!
Algorithm Updates | | airnwater0 -
On-page Optimization
Hi, I have two campaigns and neither have any statistics for on-page optimization. Am I doing something wrong or how do I make these stats appear? I would like to improve my website. Thank you in advanced for any pointers or shared experience you may give me!
Algorithm Updates | | Pixeltistic0 -
Advice on breaking page 3 SERP?
I've worked extremely hard re-ranking for the key word "kayak fishing" after our site migration and panda/penguin our site www.yakangler.com was lost in the doldrums. I couldn't find us on any of the results page 1 thru page 64. The good news is we have managed to make it to page 3 for the past month but I feel like we have hit a wall. I can't seem to get any more moment in my SERP for "kayak fishing" Google US. Anyone have any recommendations on what I should do to move us up more? We have good content that is updated daily, an active community and forum. site: www.yakangler.com key word: kayak fishing
Algorithm Updates | | mr_w0 -
Is URL appearance defined by crawling or by XML sitemap
I am having a problem developing a sitemap because I have long URLs that are made by zend. They go like this: http://myagingfolks.com/professionals/20661/social-workers/pennsylvania-civi-stanger Because these URL's are long and are fed by Zend when I try to call them all up, to put on the sitemap, the system runs out of memory and crashes. Do you know what part of a search result, in google, say, comes from the URL? Would it be fine for me to submit to google only www.myagingfolks.com/professionals/20661. Does the crawler find that the URL is indeed http://myagingfolks.com/professionals/20661/social-workers/pennsylvania-civi-stanger or does it go with just what the sitemap tells it?
Algorithm Updates | | Jordanrg0