A Serious drop in Pages crawled per day
-
On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.
Here is my website url - http://www.wpstuffs.com/
-
What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles. What changed round about then that would have caused an increase in load times?
If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare. Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added? Pingdom tools is also great for picking apart load times.
That would be where I'd start...
-
Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.
Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.
Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.
-
Yes, well there are a couple of things to consider and test.
First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.
Have you changed platforms?
If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
GSC Performance completely dropped off, but Google Analytics is steady. Why can't GSC track my site anymore?
Hey everyone! I'm having a weird issue that I've never experienced before. For one of my clients, GSC has a complete drop-off in the Performance section. All of the data shows that everything fell flat, or almost completely flat. But in Google Analytics, we have steady results. No huge drop-off in traffic, etc. Do any of you know why GSC would all of a sudden be unable to crawl our site? Or track this data? Let me know what you think!
Algorithm Updates | | TaylorAtVelox
Thanks!2 -
Anyone suspect that a site's total page count affects SEO?
I've been trying to find out the underlying reason why so many websites are ranked higher than mine despite seemingly having far worse links. I've spent a lot of time researching and have read through all the general advice about what could possibly be hurting my site's SEO, from page speed to h1 tags to broken links, and all the various on-page SEO optimization stuff....so the issue here isn't very obvious. From viewing all of my competitors, they seem to have a much higher number of web pages on their sites than mine does. My site currently has 20 pages or so and most of my competitors are well in the hundreds, so I'm wondering if this could potentially be part of the issue here. I know Google has never officially said that page number matters, but does anyone suspect that perhaps page count matters towards SEO and that competing sites with more total pages than you might have an advantage SEOwise?
Algorithm Updates | | ButtaC1 -
Rel canonical on other page instead of duplicate page. How Google responds?
Hi all, We have 3 pages for same topics. We decided to use rel canonical and remove old pages from search to avoid duplicate content. Out of these 3 pages....1 and 2 type of pages have more similar content where 3 type don't have. Generally we must use rel canonical between 1 and 2. But I am wondering what happens if I canonical between 1 and 3 while 2 has more similar content? Will Google respects it or penalise as we left the most similar page and used other page for canonical. Thanks
Algorithm Updates | | vtmoz0 -
Anyone else notice a traffic drop around June 28th 2016?
Hey guys, i know there is a lot of chatter about a potential google update on / around June 28th... well, one of the sites I manage was hit pretty bad. I have attached an image showing what our ranking looked like before and after the unconfirmed update. As you will see, we plummeted that day and have not yet recovered. Has anyone else experienced drops? I'm trying to identify potential causes. I've started an SEO audit and so far I have identified 1 big fish and a few niggly bits. Big Fish: non-www version of site had redirect rule overwritten by CloudFlare page rules and is using a 302 redirect instead of a 301. Now could this be the cause? Niggly bits: technical SEO issues and optimisations like having unique meta titles etc. If you have noticed drops or think you can shed some light on my situation that will help me then I would love to hear from you 🙂 Thanks upload.png upload.png
Algorithm Updates | | OptiBacUK0 -
Dealing with Omitted Page
For my most competitive term, the wrong page ranks (and not well either). The landing page I built for it has never shown up for that term except after I include the omitted results. The page that does rank is category page page above it. All that's fine, because neither page was all that great...BUT, I have completely re-written the content for the landing page, got local area pictures, local testimonials and a video. So here's my question: Should I put all that content on the landing page that's been omitted or tweak the page that ranks and put it there? To me it makes the most sense to put the content on the page that has been omitted, but I don't know how google treats pages that have been omitted in the past. Is it going to have some sort of bias against the page, because it was omitted so many times earlier for that keyword? Or, will it be treated just like any other page, and if the content is good enough, then it will rank just fine. If anyone's dealt with this, then I'd love to hear all about it! Thanks, Ruben
Algorithm Updates | | KempRugeLawGroup0 -
Question About : Redirecting Old Pages to New & More Relevant Ones
I'm looking over a friends website, which used to have great natural ranking for some big keywords. Those ranking & CTR's have dropped a lot, so the next thing I checked into was top selling Brand & Category pages. Its seems like every year or so a New Page was constructed for each brand... Many of which have high quality and natural inbound links. However, the pages no longer have products and simply look outdated. I'm trying to figure out if they should place redirects on all the old pages to a new URL which is more seo friendly. Example Links : http://www.xyz.com/nike2004.html , http://www.xyz.com/nike-spring2006.html , http://www.xyz.com/2011-nike-shoes.html - (have quality inbound links, bad content) .... Basically would it be advantageous to place redirects on all of these example pages to a new one that will be more permanent... http://www.xyz.com/nike-shoes.html I'm also looking at about 15 brands and maybe 100+ old/outdated urls, so I wasn't sure if I should do this & to what extent. Considering many of the brand pages do rank, but not as well as they should... Any input would help, thanks
Algorithm Updates | | Southbay_Carnivorous_Plants0 -
Has anyone seen this before? One domain dominates the entire first page!
Do a google search for "sober college" and tell me you don't see the entire page filled with one domain. (except the last result)
Algorithm Updates | | EmarketedTeam0 -
When did Google include display results per page into their ranking algorithm?
It looks like the change took place approx. 1-2 weeks ago. Example: A search for "business credit cards" with search settings at "never show instant results" and "50 results per page", the SERP has a total of 5 different domains in the top 10 (4 domains have multiple results). With the slider set at "10 results per page", there are 9 different domains with only 1 having multiple results. I haven't seen any mention of this change, did I just miss it? Are they becoming that blatant about forcing as many page views as possible for the sake of serving more ads?
Algorithm Updates | | BrianCC0