Sudden inexplicable drop in important keywords
-
I have been running around in small circles trying to work out why, after a year of careful SEO my companies site has suddenly dropped for all it's main keywords out of the first page to the second or third in our weekly report.
One theory was that five backlinks with a spam rating of 10 might have had an impact - these have been removed, but I have been advised that these may not have been the cause.
Our crawl diagnostics remain squeaky clean.
I add one, carefully checked and optimized (as per Moz recommendations) blog posts once a week and nothing has been changed other than that.
We have slowly and carefully built up a good backlink profile, but as well as the drop in rankings our weekly report also showed that we lost 109 backlinks from the previous week.
I have not been able to find out what I could possibly have done wrong!
I've checked all our crawl reports and webmaster tools and nothing has been flagged up.
I did discover, whilst typing in some longtail keyword phrases that our preview site URLs as well as our live site URLs appeared in SERPs. I checked with our web agency who assured me that this was fine, but that they had put a redirect on these yesterday. I thought this was a bit strange as that seems odd as we have been live for a year. I guess my question is could the fact that these redirects have not been active (until yesterday) have any bearing on what has happened or is this completely unrelated?
Thanks
Catherine - very stressed Mozer
-
The rel canonical tag to the root of the site could work, but would be better to have a metatag like
<metaname="robots" content="noindex, nofollow"> </metaname="robots">
For each page that is developmental and not supposed to be live. This will tell google to just ignore these pages, that they are not ready to be indexed and be part of the internet.
It's generally not recommended to do a rel canonical to the homepage, just because it's saying that every page on the developmental site is from the homepage, as well google is still indexing these pages and this could cause issues later on. It's just better to noindex nofollow the dev pages before they go live, since then you can migrate the new to the old and not have some huge issue later on.
I send something like this to your private message as well.
-
Hello Deacyde
Could I ask you another question related to this issue?
The web developer has now added a rel canonical (I'm assuming to the root of our site).
My question is, is it good practice to add a rel canonical to a site which has a development (preview) site, where there will potentially be two urls for each page (the development page and the live page) within serps?
I was told by the web developer that this was not an issue and that it was unimportant.
Is this the case or have they simply forgotten to do it and are now dismissing it as non issue?
That's my question - I hope you don't mind me following up with you - it's just you know the story from the start.
Kind regards
Catherine (work with Zoe)!
-
You're very welcome, glad this helped.
As a web developer and SEO I understand far too often that the two worlds are not in constant communication about many of the things that matter. As well aren't always up to par with latest knowledge from each opposing fields.
This far too often leads to those moments where things happen.
Glad you monitored these and spoke up to seek answers, if not you, who else would have? That's always the scary part.
-
Hello Deacyde
I'm writing to thank you again for you help. I asked our web design agency to remove the 92 offending urls yesterday. They did as requested but I got a curt email a close of play last evening telling me that the remove process would not be immediate and the preview site urls where not the reason for the drop in ranking.
Today, I checked and all the urls for the preview site have disappeared. Our visibility has risen 45% and we are now ranking #2 for our main keyword phrase (we had dipped down to 10 last week).
So thank you very much for you advice and constructive help
Kind regards
Catherine Joyce
-
Hello,
Ok, that certainly can cause some ranking issues, if persay you've for whatever reason got both the preview / development site being indexed as well as the live site, that will confused google and possibly mean that you'd either loose ranking for those keywords or even not be considered at all for that keyword query.
Something that could be tried is to go into Google's Webmaster Tools and click on Google Index > Remove URL, this is a temporary url removal tool that google has incase of mistakes and such. Might be worth it to have the preview sites you've seen indexed entered in the URL removal tool and even do a site:domain.com ( replace the domain.com with the preview site domain ) to see what all is being indexed still and maybe even add those as well.
You're main goal is to basically tell google to forget those URLs, as long as the preview site has noindex nofollow on it now and you remove those currently indexed urls in WMTs you might be able to recover some of that rank loss if not all.
I'd also do some research to see if competitors have made any recent changes that would increase their visibility but to ultimately remember that there is signs of a google update release brewing as well, so if the above actions yield no results, next best option is to wait a few weeks while tackling other tasks.
Hopefully this has helped
Here is some site migration guides to help in the future as well to prevent this kinda issue:
-
Hello Deacyde
When I'm talking about the preview site, I'm referring to the site we build our site in. When we are happy we then build live. However I have noticed that we now have both the preview url and the live url (with the same content) appearing in serps. When I pointed it out the the web design agency who sold us the software and manage the site they told me that they had set up the redirect yesterday (the same day I told them about the rankings drop)!
-
When you say preview site do you mean your development site as in when you do redesigns, is the preview site domain where you host the redesign site before it's live?
Also, not sure if you have noticed but there seems to be some testing or even a Google update in the works, and with Google still yet to release Penguin never know.
I've been experiencing 1 to 2 page dances with keyword rankings over the last 6 days for our major keywords, some appearing on page 2 at the beginning of the day and then appearing on page 4 around the end of the day, doing this consistently over the last 3 days.
So certainly seems SERPs is being adjusted, just not sure as to the why.
If you have been concerned about keyword changes over the passed week, I'd say to hold tight that the rest of us are experiencing this as well and just are in the mercy of Google.
If it's been longer than that, then you might have competition that's doing things better, got to remember that for every site that increases in rank, the rest of the sites adjust to that.
**Edited to add the link of the recent update chatter: https://www.seroundtable.com/google-update-chatter-22306.html
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Huge Drop in Direct Traffic in G4
Our direct traffic dropped 50% in October. Is anyone else seeing a drop in direct traffic in October in G4? It hasn't shifted to another source or unassigned it's just gone. Has anyone else experienced this and what might be the reasons?
Intermediate & Advanced SEO | | inhouseninja1 -
Seem to have dropped completely out of the rankings
Hello there, I have a site that seems to have totally dropped out of the rankings i.e. it is now not even ranking for the name, at which it has been number 2 forever! In Moz Pro it is at 0% visibility and no keywords being ranked. No big changes in terms of the site, the pages appear to be being indexed and as far as I'm aware no dodgy backlinks. The only change lately is that we have linked it to Google Console, added 2 content pages and done a Google Adwords campaign. These pages have been used as the landing pages for this campaign - could that have had this effect? Could this be a RAG (Random Act of Google) or something else??? The site is homefarmlogs.co.uk. The is also a homefarmlogs.com - could this be causing a problem??? Any advice would be greatly appreciated. Best wishes, Sarah.
Intermediate & Advanced SEO | | Frog-Marketing1 -
How important is the file extension in the URL for images?
I know that descriptive image file names are important for SEO. But how important is it to include .png, .jpg, .gif (or whatever file extension) in the url path? i.e. https://example.com/images/golden-retriever vs. https://example.com/images/golden-retriever.jpg Furthermore, since you can set the filename in the Content-Disposition response header, is there any need to include the descriptive filename in the URL path? Since I'm pulling most of our images from a database, it'd be much simpler to not care about simulating a filename, and just reference an image id in my templates. Example: 1. Browser requests GET /images/123456
Intermediate & Advanced SEO | | dsbud
2. Server responds with image setting both Content-Disposition, and Link (canonical) headers Content-Disposition: inline; filename="golden-retriever"
Link: <https: 123456="" example.com="" images="">; rel="canonical"</https:>1 -
Unexplained Drop In Ranking and Traffic-HELP!
I operate a real estate web site in New York City (www.nyc-officespace-leader.com). It was hit by Penguin in April 2012, with search volume falling from 6,800 per month in March 2012 to 3,300 by June 2012. After refreshing content and changing the theme, volume recovered to 4,300 per month in October 2013. There was a big improvement in early October 2013, perhaps tied to a Panda update. In November 2013 I hired an SEO company. They are reputable; on MOZ's recommended list. After following all their suggestions (searching and removing duplicate content, disavowing toxic links, improving the site structure to make it easier for Google to index listings, re-writing ten key landing pages, improving the design of the user interface) ranking and traffic started to decline in April of 2014 and crashed in June 2014 after an upgraded design with improved user interface was launched. Search volume is went from 4700 in March to around 3800 in June. However ranking on the keywords that generate conversions has really declined, and clicks from those terms are down at least 65%. My online business is severely compromised after I have spent almost double the anticipated budget to improve ranking and conversion. A few questions: 1. Could a drop in the number of domains lining to our site have led to this decline? About 30 domains that had toxic links to us agreed to remove them. We had another 70 domains disavowed in late April. We only have 78 domains pointing to our domain now, far less than before (see attached AHREFs image). It seems there is a correlation in the timeline between the number of domains pointing to us and ranking performance. The number of domains pointing to us has never been this low. Could this be causing the drop? My SEO firm believes that the quality of these links are very low and the fact that many are gone is in fact a plus. 2. The number of indexed pages has jumped to 851 from 675 in early June (see attached image from Google Webmaster tools), right after a site upgrade. The number of pages in the site map is around 650. Could the indexation of the extra 175 page somehow have diluted the quality of the site in Google's eyes? We have filed removal request for these pages in Mid June and again last week with Google but they still appear. In 2013 we also launched an upgrade and Google indexed an extra 500 pages (canonical tags were not set up correctly) and search volume and ranking collapsed. Oddly enough when the number of pages indexed by Google fell, ranking improved. I wonder if something similar has occurred. 3. May 2014 Panda update. Many of our URLs are product URLs of listings. They have less than 100 words. Could Google suddenly be penalizing us for that? It is very difficult to write descriptions of hundreds of words for products that change quickly. I would think the Google takes this into account. If someone could present some insight into this issue I would be very, very grateful. I have spent over $25,000 on SEO reports, wireframe design and coding and now find myself in a worse position than when I started. My SEO provider is now requesting that I purchase even more reports for several thousand dollars and I can't afford it, nor can I justify it after such poor results. I wish they would take it upon themselves to identify what went wrong. In any case, if anyone has any suggestions I would really appreciate it. I am very suspicious that this drop started in earnest at the time of link removal and the disavow and accelerated at the time of the launch of the upgrade. Thanks, Alan XjSCiIdAwWgU2ps e5DerSo tYqemUO
Intermediate & Advanced SEO | | Kingalan10 -
Keyword research Methods
I am Looking for keyword research guide .because there are many ask about keyword research no idea where i can start .plz expert advice highly appreciate.
Intermediate & Advanced SEO | | innofidelity0 -
Keyword density for a website
I wanna make landing pages for my web site .going to write 500 words article but how about keyword density .i wanna insert 4 keywords into that article.looking for expert advices .
Intermediate & Advanced SEO | | innofidelity0 -
Why did my rankings drop?
Hi all, In July I started to re-energise my link building efforts by getting a proper campaign together to build links. Despite building about 20 new links my traffic has actually fallen. Here a a breakdown of what happen: 1)Late June I noticed my toolbar page rank up at about PR4 which, despite only being a small part of the algo, was nice to see. Early July I started my link building campaign by getting together a massive list of potential link partners by using Open Site Explorer on my competitors sites. 3)Because I'm a bit pressed for time I decided to go for the easier links first. I sorted my link list by Domain Authority and started to list on high DA directories used by my competitors. I listed on about 20 of these directories. I also livened up an old links page I'd previously hidden from the SE's because I was planning to do a bit of Link exchanging too. A few days after I started building links from these directories I noticed my traffic start to drop off gradually. I also noticed the toolbar PR go down to PR3. I decided to stop at 20 submissions because it looked like this was effecting traffic. I also removed the links page I'd livened up which produced a temporary improvement in traffic but it's since gone on to get a bit worse. Traffic is now down by about 10% on when I started buying submissions to directories. I must add that during this period we have also been taking on new clients which, as a a real estate listing site, means we put loads of content on our site for the client. That content is also on the clients website and on other competitors sites. So there would be lot's of a content that appears elsewhere on the net. Not really sure which of the two has caused the problem and not really sure how to progress. Do I remove the links on the directories? Do I wait for this newly added content to bed down so that new fresh can take it's place in our results which we rank from? Any help would be appreciated.
Intermediate & Advanced SEO | | Mulith0 -
Multiple Keyword Research Questions, Help
Hello , I've been trying for several days to understand how keyword research works for a multi purpose website,I've read guides, articles even some chapters from the book" The Art of Seo" by O'Reilly and still no luck. It seems i can't wrap my head around keyword research,lets say I have a social gaming community website and I'm trying to rank it first on some low competition keywords + some long tail keywords.The website has functions like leaderboards, profiles,events, competitions,etc so it's not actually a news related website but it will have a blog. My website being on the games niche It would imply that I should target words that contain the word "Games" but this word generates millions of searches globally so ranking first its nearly impossible if the website is brand new. This made me pursue generic keywords formed with 2 / 3 words like fresh games, new games, mmorpg games, fps games,etc which still generate lets say 30.000 searches globally each. Due to the different areas of the website like latest game events,latest games competitions,etc I'm confused If i should pursue website specific keywords like latest games events, fresh games events, latest games competitions, upcoming games competitions but these too generate 30.000 global searches each,so... 0.should i use generic keywords or keywords that include site features? So let's say I decide to pursue generic "games" keywords,due to a high competition based on the keyword I decide to go a layer deeper and for the keyword "fresh games" I obtain keywords like** "fresh games 2011,top fresh games 2011, upcoming fresh games** " and thus building a list of 30 keywords that contain " fresh games".If i do this for the rest of the keywords: ** new games, mmorpg games, fps games,etc** I end up with a list of 10.000 keywords or more since each keyword generates other keywords. Is this the correct approach ? since generating 10.000 keywords sounds a lot and I'm getting the feeling that It's not how it supposed to be done,like were would I insert 10.000 keywords? So how do I know which keywords to pick and aim in order to try to get no.1 ranking? and why those? How many keywords should I use? and where should i put them? since it's not a news website so writing a lot of articles isn't an option. Should I focus on 2 words keywords with around 10.000-30.000 seaches or 2 words keywords + long tail keywords with less traffic like 100 - 5000? Is there a guide for the Keyword Analysis Tool since if i enter "fresh new games" i get a 39% keyword difficulty,is that hard to rank? and I don't know what all those color mean since some of them have higher numbers then others that are found at the top and how can i get beat a website that has has rank 10. So hopefully with your help & by some miracle I will finally be able to build a keyword list. Thank you !
Intermediate & Advanced SEO | | arching0