Site deindexed after HTTPS migration + possible penalty due to spammy links
-
Hi all, we've recently migrated a site from http to https and saw the majority of pages drop out of the index.
One of the most extreme deindexation problems I've ever seen, but there doesn't appear to be anything obvious on-page which is causing the issue. (Unless I've missed something - please tell me if I have!)
I had initially discounted any off-page issues due to the lack of a manual action in SC, however after looking into their link profile I spotted 100 spammy porn .xyz sites all linking (see example image).
Didn't appear to be any historic disavow files uploaded in the non https SC accounts.
Any on-page suggestions, or just play the waiting game with the new disavow file?
-
Thanks for answering all of my questions!
It's interesting that when I do a simple site:search in Google none of the main pages of your website are appearing. Most of the search results are either archives or comments. Typically, I've seen this kind of thing happen when something goes wrong in the redirects or a site is penalized.
It looks like the big dip in indexation didn't occur until about August. I would think that if you pulled the trigger in June, pages would start dropping out of the index much sooner.
In this case, your theory about a possible penalization might be right. I'd be interested to see what happens once Google considers the disavow file (unfortunately, that will take some time).
Does anyone else have any input or possible reasons why pages on this site have dropped out of the index so quickly?
-
Hi Serge,
Thanks for your input. I've answered your questions below.
- How long ago did you switch to https? - 21st June
- Have you submitted both non-www and www versions of the https site to Google Search Console (GSC)? - Yes
- Have you kept the http versions of your website in GSC? - Yes
- From the looks of it, your sitemap has been updated to reflect the https pages. Have you submitted the updated sitemap to GSC? - Yes - Submitted pages are not matching Indexed pages
- Are there any sitemap errors appearing in GSC? Any other errors? No Sitemap Errors. some 404ing pages.
- Could you attach a screenshot of the indexation rate on both https and http versions of the site from GSC?
- Could you confirm that all redirects were done 1-to-1 and properly redirected? (301s and not 302s) - Confirmed - all tools are reporting 200 status after hitting the 301.
We are still waiting to see some results from submitting the disavow file. So far, no positive movement.
Thanks for your help!
-
Hi there,
There could be a lot of reasons why certain pages of your website are dropping out of your index. Could you answer the following questions to help us narrow down the possible cause?
- How long ago did you switch to https?
- Have you submitted both non-www and www versions of the https site to Google Search Console (GSC)?
- Have you kept the http versions of your website in GSC?
- From the looks of it, your sitemap has been updated to reflect the https pages. Have you submitted the updated sitemap to GSC?
- Are there any sitemap errors appearing in GSC? Any other errors?
- Could you attach a screenshot of the indexation rate on both https and http versions of the site from GSC?
- Could you confirm that all redirects were done 1-to-1 and properly redirected? (301s and not 302s)
Some things that we could rule out:
- It looks like the site isn't using noindex tags in a way that would cause deindexing
- It looks like the robots.txt file isn't disallowing any important paths that would cause deindexation
- The http version of the www and non-www pages redirects to the www, https version of the site which is good
- Canonicals seem to be updated and pointing to the https version of the site
Sorry for all of the questions, I just want to make sure and rule out possible causes to focus in on what the issue could be.
Thanks, Serge
-
Hi!
what information do you seen in search console?
Assuming that you have already tested all of your old URL's and the redirection paths points correctly to the new URLs, does Google Search console indicates any problems with the number of URLs submitted to it?
canoncals? are they in use? pointing to the correct version of the site?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Base href + relative link href for canonical link
I have a site that in the head section we specify a base href being the domain with a trailing slash and a canonical link href being the relative link to the domain. <base <="" span="">href="http://www.domain.com/" /> href="link-to-page.html" rel="canonical" /> I know that Google recommends using an absolute path as a canonical link but is specifying a base href with a relative canonical link the same thing or is it still seen as duplicate content?
Intermediate & Advanced SEO | | Nobody16116990439410 -
Recovery from manual penalty, several sites sell same products
We are still struggling with the consequences of a manual penalty. Here the history we got a manual penalty in September 2013 on our main site kinderwagen.com for unnatural links we cleaned up our link profile and the penalty was lifted in February 2014 we did nothing in terms of link building until December 2014 from December 2014 we started to build natural links, we mostly gave away our products for reviews, that way we built first one content link per month now 2-3 content links per months we expanded our social acitivities on facebook and google plus we started a blog in the beginning of this year and rewrote our guide section For now the results of all this have been very modest. We are basically still stuck where we were after the penalty. In contrast our sites in other languages where we do similar activities perform quite well. There is one difference in Germany (where this kinderwagen.com is) we have other niche sites which partially sell the the same products. We made sure that every product is indexed only once, however it might still hurt the main site. Does anyone have experience in a similar situation or advice what we could do? Thanks in advance. Dieter
Intermediate & Advanced SEO | | Storesco0 -
Migrate site from HTML to Wordpress and retain SEO
Hi guys this is a 2 part question so hoping someone is able to assist! 🙂 I own the www.industrytix.com.au/ website which ive been updating manually in Dreamweaver for last 6+ years, it has very high Organic Rankings for most of my targeted keywords which are: industry tix
Intermediate & Advanced SEO | | IsaCleanse
Industry tickets
breakfest tickets
Stereosonic tickets
CUban Club tickets
etc etc - essentially names of events Im currently about 90% of the way through replicating/improving the content of the website using a Wordpress Theme which is located at www.industrytix.com.au/buy-tickets/ so all the URLs/Sites are currently running concurrently. Im using Eventum Theme for hosting events and Woocommerce plugin for products so there is a slighy disconnect between the 'Event Page' and 'Buy tickets/Product page" **For example:
Event page: **http://industrytix.com.au/buy-tickets/breakfest-perth/ Ticket/product page: http://industrytix.com.au/buy-tickets/product/breakfest-ticket-perth/ Next step is to kill off the old outdated homepage and recirrect all the event pages to the new ones - for retaining SEO value is there a best practices for completing this? (I am planning to move the New WP Installation into the root folder from the /buy-tickets/ folder where its currently staged. For example of OLD to NEW redirrection requirements:
OLD http://www.industrytix.com.au/cuban-club-perth-tickets.php
NEW http://industrytix.com.au/buy-tickets/cuban-club-perth-nyd/ OLD http://www.industrytix.com.au/breakfest-tickets.php
NEW EVENT PAGE http://industrytix.com.au/buy-tickets/breakfest-perth/
Nicket/product page: http://industrytix.com.au/buy-tickets/product/breakfest-ticket-perth/ Any other feedback improvements as far as retaining SEO and not keyword stuffing etc? Thanking you all in advance for taking the time to read this 🙂0 -
Sitewide Footer Links & Sister Sites
Hi We have a number of sister sites across Europe - the sites are under a different domain name, but have a very similar layout & product offering. When looking at duplicate content, they are flagged as being a moderate risk with similar content - we don't duplicate product content, however it's similar. We also link to them in the footer in a drop down - not anchor text links - however this is still seen by Google. I don't think I'll be able to remove links to our sister companies, but should I implement the Href lang if the sites are slightly different? Or find another way to link to them? Here's an example http://www.key.co.uk/en/key & https://www.manutan.fr/fr/maf
Intermediate & Advanced SEO | | BeckyKey0 -
Chinese Site Ranking for our brand name - possible hack?
Hello, We have been notified in the weekly MOZ rankings that we no longer rank for our brand name, which is almost unthinkable as nobody would target it. When I googled it, there is a Chinese site ranking at number one and using our brand name and meta data. What is very strange is that although our internal pages rank in the secondary positions, our homepage does not appear at all for the brand name. Therefore, I am wondering if somehow we have had some sort of hack and they are somehow redirecting to their own site? The brand name is "uksoccershop". Has anyone ever encountered anything like this before or have any idea on what we should do? Thanks for your help.
Intermediate & Advanced SEO | | simonukss0 -
Would be the network site map page considered link spam
In the course of the last 18 months my sites have lost from 50 to 70 percent of traffic. Never have used any tricks, just simple white-hat SEO. Anyway, I am now trying to fix things that hadn't been a problem before all those Google updates, but apparently now are. Would appreciate any help.. I used to have a network site map page on everyone of my sites (about 30 sites). It basically would be a page called 'our network' and it'll show a list of links to all of my other sites. These pages were indexed, had decent PR and didn't seem to cause any problem. Here's an example of one of them:
Intermediate & Advanced SEO | | romanbond
http://www.psoriasisguide.ca/psoriasis_scg.html In the light of Panda and Penguin and all these 'bad links' I decided to get rid of most of them. My traffic didn't recover at all, it actually went further down. Not sure if there is any connection to what I'd done. So, the question is: In your opinion/experience, do you think such network sitemap pages could be causing penalties for link spam?0 -
How hard would it be to take a well-linked site, completely change the subject matter & still retain link authority?
So, this would be taking a domain with a domain authority of 50 (200 root domains, 3500 total links) and, for fictitious example, going from a subject matter like "Online Deals" to "The History Of Dentistry"... just totally unrelated new subject for the old/re-purposed domain. The old content goes away entirely. The domain name itself is a super vague .com name and has no exact match to anything either way. I'm wondering, if the DNS changed to different servers, it went from 1000 pages to a blog, ownership/contacts stayed the same, the missing pages were 301'd to the homepage, how would that fare in Google for the new homepage focus and over what time frame? Assume the new terms are a reasonable match to the old domain authority and compete U.S.-wide... not local or international. Bonus points for answers from folks who have actually done this. Thanks... Darcy
Intermediate & Advanced SEO | | 945010 -
Link Request Email on Site`s Link Pages
Hello I have assembled a list of web-sites that have "Links" section that has a list of persons` favorite tools. Those pages have a link to my competitor. I know my tool is just as good if not better and want to request a link. I`m thinking of sending an email asking for a link and offering a small amount of money for it. Questions: A) How much should I offer? Should I offer anything at all B) Is there an email style that someone can suggest that has been tested and proven to work for this type of situtation?
Intermediate & Advanced SEO | | hellopotap0