Site deindexed after HTTPS migration + possible penalty due to spammy links
-
Hi all, we've recently migrated a site from http to https and saw the majority of pages drop out of the index.
One of the most extreme deindexation problems I've ever seen, but there doesn't appear to be anything obvious on-page which is causing the issue. (Unless I've missed something - please tell me if I have!)
I had initially discounted any off-page issues due to the lack of a manual action in SC, however after looking into their link profile I spotted 100 spammy porn .xyz sites all linking (see example image).
Didn't appear to be any historic disavow files uploaded in the non https SC accounts.
Any on-page suggestions, or just play the waiting game with the new disavow file?
-
Thanks for answering all of my questions!
It's interesting that when I do a simple site:search in Google none of the main pages of your website are appearing. Most of the search results are either archives or comments. Typically, I've seen this kind of thing happen when something goes wrong in the redirects or a site is penalized.
It looks like the big dip in indexation didn't occur until about August. I would think that if you pulled the trigger in June, pages would start dropping out of the index much sooner.
In this case, your theory about a possible penalization might be right. I'd be interested to see what happens once Google considers the disavow file (unfortunately, that will take some time).
Does anyone else have any input or possible reasons why pages on this site have dropped out of the index so quickly?
-
Hi Serge,
Thanks for your input. I've answered your questions below.
- How long ago did you switch to https? - 21st June
- Have you submitted both non-www and www versions of the https site to Google Search Console (GSC)? - Yes
- Have you kept the http versions of your website in GSC? - Yes
- From the looks of it, your sitemap has been updated to reflect the https pages. Have you submitted the updated sitemap to GSC? - Yes - Submitted pages are not matching Indexed pages
- Are there any sitemap errors appearing in GSC? Any other errors? No Sitemap Errors. some 404ing pages.
- Could you attach a screenshot of the indexation rate on both https and http versions of the site from GSC?
- Could you confirm that all redirects were done 1-to-1 and properly redirected? (301s and not 302s) - Confirmed - all tools are reporting 200 status after hitting the 301.
We are still waiting to see some results from submitting the disavow file. So far, no positive movement.
Thanks for your help!
-
Hi there,
There could be a lot of reasons why certain pages of your website are dropping out of your index. Could you answer the following questions to help us narrow down the possible cause?
- How long ago did you switch to https?
- Have you submitted both non-www and www versions of the https site to Google Search Console (GSC)?
- Have you kept the http versions of your website in GSC?
- From the looks of it, your sitemap has been updated to reflect the https pages. Have you submitted the updated sitemap to GSC?
- Are there any sitemap errors appearing in GSC? Any other errors?
- Could you attach a screenshot of the indexation rate on both https and http versions of the site from GSC?
- Could you confirm that all redirects were done 1-to-1 and properly redirected? (301s and not 302s)
Some things that we could rule out:
- It looks like the site isn't using noindex tags in a way that would cause deindexing
- It looks like the robots.txt file isn't disallowing any important paths that would cause deindexation
- The http version of the www and non-www pages redirects to the www, https version of the site which is good
- Canonicals seem to be updated and pointing to the https version of the site
Sorry for all of the questions, I just want to make sure and rule out possible causes to focus in on what the issue could be.
Thanks, Serge
-
Hi!
what information do you seen in search console?
Assuming that you have already tested all of your old URL's and the redirection paths points correctly to the new URLs, does Google Search console indicates any problems with the number of URLs submitted to it?
canoncals? are they in use? pointing to the correct version of the site?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Possible to Migrate Website Design to Different Theme?
Last year we purchased a $79 them and coded a new designer our real estate website. The database of listings was transferred to the new theme. A year later we realize the new theme is not that fast; does not perform great, so despite optimizing our server we are not getting very fast performance. So, my question is, can we take the design, the CSS of our current theme (and database) and transfer it to a better performing theme? We are in a very competitive niche and our website must perform quickly both desktop and mobile. If this is feasible is this a major production? Note we are very happy with the design and this would solely be to improve download speeds to improve the user experience and get better ranking. Thanks, Alan
Intermediate & Advanced SEO | | Kingalan10 -
Migrating 1 page to https
Hi there, Although we do plan to migrate our entire site to https, we currently have only one page on our site which we want to migrate to https, as it has passwords and wotnot on it. Lets say it is httpS://www.example.com/login/ I am not really sure how to go about migrating just one page though.
Intermediate & Advanced SEO | | unirmk
I am guessing that we need to: make sure that httpS://www.example.com/login/ is the only page that exists on httpS:// replace any link to the httpS://www.example.com/login/ version on the http:// version remove httpS://www.example.com/login/ from the http://www.example.com/sitemap.xml create a httpS://www.example.com/sitemap.xml on httpS:// which only references the one page (httpS://www.example.com/login/) 301 http://www.example.com/login/ to https://www.example.com/login/ submit both sitemaps to Google so they know whats up. fetch http://www.example.com/login/ so that google finds the redirect. Anything else?? :S Not too sure about this one. Many thanks for your help.0 -
How do you handle a site with inherited negative links, but no penalty?
I'm trying to rank a new client for various key phrases that contain "it support." The problem is that about 100 of their 180 total referring domains have links that include "it support" (usually as partial match, or if exact then for uninteresting terms with low traffic), mostly on quite low quality directories. So, no penalty, and not much exact match I'm worried about, but I'm concerned that there's too high a percentage overall of partial match or simpy "it support"-based links for me to continue building keyword-optimized links to try and rank for the much harder terms we need to rank for... Despite the large number of low quality directories, a disavowal does not seem like a good idea since there is no penalty, but how does one avoid being handicapped by such bad links that came before one's time?
Intermediate & Advanced SEO | | zakkyg0 -
When the site's entire URL structure changed, should we update the inbound links built pointing to the old URLs?
We're changing our website's URL structures, this means all our site URLs will be changed. After this is done, do we need to update the old inbound external links to point to the new URLs? Yes the old URLs will be 301 redirected to the new URLs too. Many thanks!
Intermediate & Advanced SEO | | Jade1 -
Chinese Site Ranking for our brand name - possible hack?
Hello, We have been notified in the weekly MOZ rankings that we no longer rank for our brand name, which is almost unthinkable as nobody would target it. When I googled it, there is a Chinese site ranking at number one and using our brand name and meta data. What is very strange is that although our internal pages rank in the secondary positions, our homepage does not appear at all for the brand name. Therefore, I am wondering if somehow we have had some sort of hack and they are somehow redirecting to their own site? The brand name is "uksoccershop". Has anyone ever encountered anything like this before or have any idea on what we should do? Thanks for your help.
Intermediate & Advanced SEO | | simonukss0 -
Link building… how to get high rewarding links?
Hi Guys, I have a few people whom I have built relationships up in my industry with that would like to link to my site. Is there any particular things I need to be mindful of before having them link to me? I'm just mindful of the unknown. Also, which links to use etc? Thanks in advance
Intermediate & Advanced SEO | | edward-may0 -
Internal Link Analysis (Site Wide)
Hi i'm currently doing a internal link analysis for one of my clients and want to pull internal link data for the entire website. So i can look at the distribution of internal anchor text and to identify ways in which we can optimize internal linking. I have had a look at screaming frog the trouble is, this data is only exportable one page at a time. Meaning, you can’t export an entire site “In Link” data. The site has 200+ pages so pulling in link data for each page would take quite long! Can anyone recommend anyways or tools which can look at the entire link profile for a website. I have checked OSE but there's not much data because the site is relatively new. Cheers, RM
Intermediate & Advanced SEO | | MBASydney0 -
Best strategy for "product blocks" linking to sister site? Penguin Penalty?
Here is the scenario -- we own several different tennis based websites and want to be able to maximize traffic between them. Ideally we would have them ALL in 1 site/domain but 2 of the 3 are a partnership which we own 50% of and why are they are off as a separate domain. Big question is how do we link the "products" from the 2 different websites without looking spammy? Here is the breakdown of sites: Site1: Tennis Retail website --> about 1200 tennis products Site2: Tennis team and league management site --> about 60k unique visitors/month Site3: Tennis coaching tip website --> about 10k unique visitors/month The interesting thing was right after we launched the retail store website (site1), google was cranking up and sending upwards of 25k search impressions/day within the first 45 days. Orders kept trickling in and doing well overall for first launching. Interesting thing was Google "impressions" peaked at about 60 days post launch and then started trickling down farther and farther and now at about 3k-5k impressions/day. Many keywords phrases were originally on page 1 (position 6-10) and now on page 3-8 instead. Next step was to start putting "product links" (3 products per page) on site2 and site3 -- about 10k pages in total with about 6 links per page off to the product page (1 per product and 1 per category). We actually divided up about 100 different products to be displayed so this would mean about 2k links per product depending on the page. FYI, those original 10k pages from site2 and site3 already rank very well in Google and have been indexed for the past 2+ years in there. Most popular word on the sites is Tennis so very related. Our rationale was "all the websites are tennis related" and figured that the links on the latest and greatest products would be good for our audience. Pre-Penguin, we also figured this strategy would also help us rank for these products as well for when users are searching on them. We are thinking through since traffic and gone down and down and down from the peak of 45 days ago, that Penguin doesn't like all these links -- so what to do now? How to fix it and make the Penguin happy? Here are a couple of my thoughts on fixing it: 1. Remove the "category link" in our "product grouping" which would cut down the link by 1/3rd. 2. Place a "nofollow" on all the links for the other "product links". This would allow us to get the "user clicks" from these while the user is on that page. 3. On our homepage (site2 & site3), place 3 core products that change frequently (weekly) and showcase the latest and greatest products/deals. Thought is to NOT use the "nofollow" on these links since it is the homepage and only about 5 links overall. Heck part of me debated on taking our top 1000 pages (from the 10k page) and put the links ONLY on those and distribute about 500 products on them so this would mean only 2 links per product -- it would mean though about 4k links going there. Still thinking #2 above could be better? Any other thoughts would be great! Thanks, Jeremy
Intermediate & Advanced SEO | | jab10000