Mysterious ave pageload time spikes since major redesign
-
Hello Moz Community,
About six months ago, we completely redesigned our heavily trafficked website. We updated the navigation, made the site responsive, and refreshed all the site's content. We were hoping to get a rankings boost from all the hard work we put in, but sadly our traffic began to steadily decline. We started to notice that although overall page load speeds were comparable before and after the redesign if you compared them on an hourly basis, we saw random hourly spikes in ave page load speed post redesign.
Here is a pic of our analytics comparing our hourly ave. page load speeds pre vs. post redesign: https://screencast.com/t/8WQeyhquHN (after is in blue, before in orange)
We have spent around 3 months trying to figure out the underlying cause of the new load time spikes. My question is has anyone seen anything like this before? Does anyone have any suggestions what might be causing the spikes? As far as we can tell, the spikes are indeed random and are not correlated to any particular time of day, our traffic, or other activity we are doing. Any help would be greatly appreciated!
Thanks,
Eric
-
Quick thing to check - have a look at your server logs. Those kinds of random load time increases look typical of the load spikes that are typical of bot overloads - where spambots may be hitting your pages in bursts, causing the server to overload and slow (or even reset, as Vijay mentions).
Those bot hits aren't recorded in GA - you'll have to look at the actual server access logs to find them.
Hope that helps?
Paul
-
Hi Eric,
Thanks for your response, please do update about the final solution for the benefit of all.
Let me know if you have further queries.
Regards,
Vijay
-
We have not detected anything wrong with our site from a user perspective-- that is what is so frustrating. Thanks for your time and response!
-
Thank you Vijay, I am having our developer take a look at all of our scripts.
-
Your page seems to load fine, have you personally seen the website load horribly at the times the chart and analytics indicates that it is? I don't think there is anything wrong with your site, so if the chart is actually accurate then it can only be the web host is dropping the ball
-
Hi Eric,
We had faced a similar problem with one of our clients, in the end, it was some scripts (both front-end and back-end) which were not ending/terminating properly and overloading the server. The script overload meant the server responses became slow till the resources were exhausted and reset by server mechanism. To summarize, it might be attributed to some bad scripting code.
I hope this helps.
Regards,
Vijay
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website url structure after redesign and 301 redirect chains - Looking for advice
OK, been trying to piece together what is best practice for someone I'm working with, so here goes; Website was redesigned, changed urls from url a to url b. 301's put in place. However, the new url structure is not optimal. It's an e-commerce store, and all products are put in the root folder now: www.website.com/product-name A better, more organized url structure would be: www.website.com/category/product-name I think we can all agree on that. However, I'm torn on whether it's worth changing everything again, and how to handle things in terms of redirects. The way I see things, it would result in a redirect chain, which is not great and would reduce link equity. Keeping the products in the root moving forward with a poor structure doesn't feel great either. What to do? Any thoughts on this would be much appreciated!
Technical SEO | | Tomasvdw0 -
What would cause a major drop in ranking for (images) on both desk top and mobile? Web rankings are holding OK?
Sometime between Nov 8th and Nov 11th are rankings on Google for images dropped substantially. Our web rankings are holding OK. any idea!
Technical SEO | | OCFurniture0 -
Organic search traffic has dropped by 35% since 18 September, we don't know why.
Organic traffic to our website has dropped 35% since 18 September 2017 to date. From 1 January to 18 September 2017 organic traffic was up by just under 1% over all (Google up by 1.32%). Paid search traffic over the same time has remained steady. There is nothing we can think of that we've done that has caused the drop. We had an issue with Google page speed test failing when running a test but we resolved this issue on 20 November and in that time we've seen an even greater drop (44% in the last week). The drop is seen across the 3 main search engines, not just Google, which points toward something we've done, but as mentioned, we can't think of any significant change we made in September that would have such negative effects. There is little difference across devices. Is anyone aware of a significant event in September in the search engine world that may have influenced our organic traffic? Any help gratefully received.
Technical SEO | | imaterus0 -
Is there a way to index important pages manually or to make sure a certain page will get indexed in a short period of time??
Hi There! The problem I'm having is that certain pages are waiting already three months to be indexed. They even have several backlinks. Is it normal to have to wait more than three months before these pages get an indexation? Is there anything i can do to make sure these page will get an indexation soon? Greetings Bob
Technical SEO | | rijwielcashencarry0400 -
Timely use of robots.txt and meta noindex
Hi, I have been checking every possible resources for content removal, but I am still unsure on how to remove already indexed contents. When I use robots.txt alone, the urls will remain in the index, however no crawling budget is wasted on them, But still, e.g having 100,000+ completely identical login pages within the omitted results, might not mean anything good. When I use meta noindex alone, I keep my index clean, but also keep Googlebot busy with indexing these no-value pages. When I use robots.txt and meta noindex together for existing content, then I suggest Google, that please ignore my content, but at the same time, I restrict him from crawling the noindex tag. Robots.txt and url removal together still not a good solution, as I have failed to remove directories this way. It seems, that only exact urls could be removed like this. I need a clear solution, which solves both issues (index and crawling). What I try to do now, is the following: I remove these directories (one at a time to test the theory) from the robots.txt file, and at the same time, I add the meta noindex tag to all these pages within the directory. The indexed pages should start decreasing (while useless page crawling increasing), and once the number of these indexed pages are low or none, then I would put the directory back to robots.txt and keep the noindex on all of the pages within this directory. Can this work the way I imagine, or do you have a better way of doing so? Thank you in advance for all your help.
Technical SEO | | Dilbak0 -
Is the If-Modified-Since HTTP Header still relevant?
I'm relatively new to the technical side of SEO and have been trying to brush up my skills by going through Google's online Web-master Academy, which suggests that you need a If-Modified-Since HTTP Header tag on your site. I checked and apparently our web server doesn't support this. I've been told by a good colleague that the If-Modified-Since tag is no longer relevant as the spiders will frequently revisit a site as long as you regularly update and refresh the content (which we do). However our site doesn't seem to of been reindexed for a while as the cached version's are still showing the pages from over a month ago. So two question really - is the If-Modified-Since HTTP Header still relevant and should I make sure this is included? And is there anything else I should be doing to make sure the spiders crawl our pages? (apart from keeping them nice, fresh and useful)
Technical SEO | | annieplaskett0 -
Page authority has disappeared since redirect
As the title states, my page authority (PA) has completely disappeared for certain pages on my site.
Technical SEO | | Hughescov
I have recently had a redesign and optimised the page names, redirecting the page it has replaced.
This has been nearly 2 months now and the new pages are showing PA of 1 still.
The 301 redirects definitely work so what am I doing wrong? Thanks in advance!0 -
Impact on domain when using a subdomain for majority opf site content
Hello, We're looking to use a subdomain for a bookings engine that will also host the majority of our site content as it wil house the details of the courses that we'll be selling online. All content is currently available on www.existingdomain.co.uk A few pages will remain here but the majority will ultimately be hosted on a different IP address under a subdomain: courses.existingdomain.co.uk I am a little concerened about search engine reaction to this content separation. Would this approach dilute the rankings of www.existingdomain.co.uk? Is there anything else we need to be mindful of? We have alternative options if this is a real SEO faux pas. Thanks
Technical SEO | | Urbanfox0