A Serious drop in Pages crawled per day
-
On 21st April ,I spotted a sudden decrease in pages crawled per day.Previously it was about 5,000 bust after the drop it reached to 225.From the crawl rate never spiked.
Here is my website url - http://www.wpstuffs.com/
-
What strikes me is at the same time as your pages crawled fell off a cliff your page load time doubles. What changed round about then that would have caused an increase in load times?
If that was around the time you switched CDN, I'd be double and triple checking the new one was set up perfectly and is an improvement on cloudflare. Did all your pages suddenly get markedly bigger, perhaps due to another plugin being added? Pingdom tools is also great for picking apart load times.
That would be where I'd start...
-
Iam using WordPress blogging platform and checked the GWT and Analytics but there were no break in code.
Im using Google Pagespeed CDN service ? will that cause such problems.Previously I was using Cloudflare.
Current PageSpeed is 92 and load time is under 3seconds.I checked the pingdom report and it doesn't show any down time stats.
-
Yes, well there are a couple of things to consider and test.
First and foremost, check your GWT code and make sure that nothing's change. Same with Google Analytics.
Have you changed platforms?
If not, I would say it's "Hoy Crap Batman" time and you need to start analyzing everything. What's your Pagespeed? Is your site online? If so, was it offline earlier in the week? (Maybe you weren't checking every minute) If your site is hosted by someone else, get on the phone and demand some answers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How much content is duplicate content? Differentiate between website pages, help-guides and blog-posts.
Hi all, I wonder that duplicate content is the strong reason beside our ranking drop. We have multiple pages of same "topic" (not exactly same content; not even 30% similar) spread across different pages like website pages (product info), blog-posts and helpguides. This happens with many websites and I wonder is there any specific way we need to differentiate the content? Does Google find the difference across website pages and blog-pots of same topic? Any good reference about this? Thanks
Algorithm Updates | | vtmoz0 -
Which is the best way - to have all FAQ pages at one place, or splitted in different sections of the website?
Hi all, We have a lot of FAQ sections on our website, splitted in different places, depending on products, technologies, etc. If we want to optimize our content for Google's Featured Snippets, Voice Search and etc. - what is the best option: to combine them all in one FAQ section? or it doesn't matter for Google that this type of content is not in one place? Thank you!
Algorithm Updates | | lgrozeva0 -
Is there any way to prevent Google from using structured data on specific pages?
I've noticed that Google is now serving what looks like host-specific video cards on mobile for our site. Is there any way to control which videos are included in these lists without removing the structured data on those clip pages or user pages? We don't want to noindex those pages but we don't want content from those pages to appear as video cards. 1kzPW
Algorithm Updates | | Garrett570 -
Google cant read my robots.txt from past 10 days
http://awesomescreenshot.com/08d1s6aybc hi, my robots.txt is http://wallpaperzoo.com/robots.txt google says it cant read and has postponed the crawl.. its been 10 days and no crawl.. please help me in solving this issue.. this is save with http://hdwallpaperzones.com/robots.txt
Algorithm Updates | | toxicpls0 -
Ideas on why Pages Per Visit Dropped?
Week over week our pages per visit continue to drop. Any ideas on where to look to diagnose?
Algorithm Updates | | Aggie0 -
How to find which keywords bring traffic to a particular page on my website ?
I have been using Google Analytics and SEOMoz tools for a while now. I know which are my top landing pages and some of the keywords which bring me traffic. But I don't know which are the top searched keywords for my website as these are "not provided" by Google Analytics. More importantly, I want to know which keywords are directing traffic to a particular page on my website. Can anyone help ?
Algorithm Updates | | EricMoore0 -
Anybody else noticing some serious dung ranking well for no reason lately?
I mean, like the complete opposite of what Panda is supposed to be doing... We've just had a discussion here and each went through a bunch of examples of sites that have sprung up and are ranking with the worst, spammiest backlink profiles ever, and poor content with little to zero on-page SEO. It's not accross the board by any means, and certainly there is no obvious pattern but there were a fair few examples we just looked at (I best not provide them for ethical reasons). It just "feels" like there's something going on...
Algorithm Updates | | SteveOllington0 -
Any ideas why our category pages got de-indexed?
Hi all, I work for evenues, a directory website that provides listings of meeting rooms and event spaces. Things seemed to be chugging along nicely with our link building effort (mostly through guest blogging using a variety of anchor text). Woke up on Monday morning to find that our City pages have been de-indexed. This page: http://www.evenues.com/Meeting-Spaces/Seattle/Washington used to be at the top of page #2 in the SERPs for the keyword "Meeting Rooms in Seattle" I doubt that we got de-indexed because of our link building efforts, as it was only a few blog posts and links from profile pages on community websites. My guess is that when we did a recent 2.0 release of the site, there are now several "filters" or subcategory pages with latitude and longitude parameters in the URL + different page titles based on the categories like: "Meeting Rooms and Event Spaces in Seattle" --Main Page "Meeting Rooms in Seattle" "Classroom Venues in Seattle" "Party Venues in Seattle" There was a bit of pushback when I suggested that we do a rel="canonical" on these babies because ideally we'd like to rank for all 4 queries (Meeting Rooms, Party Venues, Classrooms, in City). These are new changes, and I have a sneaking suspicion this is why we got de-indexed. We're presenting generally the same content. Thoughts?
Algorithm Updates | | eVenuesSEO0
