De-indexing and SSL question
-
Few days ago Google indexed hundreds of my directories by mistake (error with plugins/host), my traffic dropped as a consequence.
Anyway I fixed that and submitted a URL removal request. Now just waiting things to go back to normality.
Meantime I was supposed to move my website to HTTPS this week.
Question:
Should I wait until this indexing error has been fixed or I may as well go ahead with the SSL move?
-
Let me know if you can let me see the domain?
-
PS I agree it would be nice to hear from more people I am sure you will by tomorrow.
-
I respect your want to get this right
“A few days ago, Google indexed hundreds of my directories by mistake (error with plugins/host); my traffic dropped as a consequence.
_ Anyway, I fixed that and submitted a URL removal request. Now just waiting for things to go back to normality.” _
in my opinion, you can see the change happen to the https URLs & you want to be sure that https will not let your unwanted directory back in Google's index.
I think unless you can show me your site better Search & replace will be more comfortable & faster.
Yes, I have used better search & replace many times; it’s a great tool.
Make sure you back up your site before you do a search & replace.
https://wordpress.org/plugins/better-search-replace/
I think you should be able to see everything needed and more from this great how-to the person who made it is a friend & they don't just show you how to do this on Kinsta they show you how to use Apache & Nginx as well.
It covers everything you might want to think about managed wordpress hosting if this is something you don't feel comfortable doing.
https://kinsta.com/blog/http-to-https/
I would look at Pagely, Pantheon Servebolt & Kinsta.
If it helps, I am ranked in the top 10 or 11 for assisting people on Moz. Unless you only blocked the HTTP version of your directories, then you will have the same results with https.
- Would you allow me to see the domain?
- Who is your hosting company?
Respectfully,
Tom Zickell
-
Hi Tom,
yes I have WordPress, I have read a few guides online about it.for the search and replace part, I found a plugin called Better Search Replace: https://www.wpbeginner.com/wp-tutorials/how-to-add-ssl-and-https-in-wordpress/
the instructions in the search engine journal article do the search-replace manually. The plugin should be better, have you tried it?
Good question. In all honesty, I think it's safe to go forward with an HTTPS migration.
I am a bit worried. I asked this question to many people in many forums and nobody replies. Which makes me wonder if it's something really bad. It would be nice to have additional opinions.
-
Good question. In all honesty, I think it's safe to go forward with an HTTPS migration.
A "URL removal request"
A simple move to https two different things that can be done at the same time.
if you have a certain set up please let me know I can give you better instructions on how to completely migrate over to HTTPS. Here are some of the basics below.
- https://www.searchenginejournal.com/https-migration-guide/195103/
- https://www.keycdn.com/blog/http-to-https
- https://gofishdigital.com/steps-in-website-https-migration/
if you're using WordPress
- https://www.searchenginejournal.com/wordpress-http-to-https/236969/
- Photograph https://imgur.com/q1RfhhH.jpg
Search & Replace in Files
To begin, search for instances of your domain pointing to HTTP URLs of your site.
Use the regex for **“www” **and without “www” URL cases and search for
http:\/\/(www\.)?yourdomain\.com
always search and replace your database if you have one.
remember to implement redirects
NGINX
Add the following to your Nginx config.
<code class=" language-nginx">server { listen 80; server_name domain.com www.domain.com; return 301 https://domain.com$request_uri; }</code>
Apache
Add the following to your
.htaccess
file.<code class=" language-apacheconf">RewriteEngine On RewriteCond %{HTTPS} off RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [R=301,L]</code>
6. Update your robots.txt File#
Update any hard-coded links or blocking rules you might have in your
robots.txt
that might still be pointing to HTTP directories or files- Update your robots.txt file
- Update your disavow file if you have one
- update Google search console
if you want a very quick easy way to implement HTTPS, redirects as well as certificates I recommend Cloudflare The free version should do it.
-
I hope this helps,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blogs Not Getting Indexed Intermittently - Why?
Over the past 5 months many of our clients are having indexing issues for their blog posts.
Technical SEO | | JohnBracamontes
A blog from 5 months ago could be indexed, and a blog from 1 month ago could be indexed but blogs from 4, 3 and 2 months ago aren't indexed. It isn't consistent and there is not commonality across all of these clients that would point to why this is happening. We've checked sitemap, robots, canonical issues, internal linking, combed through Search Console, run Moz reports, run SEM Rush reports (sorry Moz), but can't find anything. We are now manually submitting URLs to be indexed to try and ensure they get into the index. Search console reports for many of the URLs will show that the blog has been fetched and crawled, but not indexed (with no errors). In some cases we find that the blog paginated pages (i.e. blog/page/2 , blog/page/3 , etc.) are getting indexed but not the blogs themselves. There aren't any nofollow tags on the links going to the blogs either. Any ideas? *I've added a screenshot of one of the URL inspection reports from Search Console alt text0 -
Removing a site from Google index with no index met tags
Hi there! I wanted to remove a duplicated site from the google index. I've read that you can do this by removing the URL from Google Search console and, although I can't find it in Google Search console, Google keeps on showing the site on SERPs. So I wanted to add a "no index" meta tag to the code of the site however I've only found out how to do this for individual pages, can you do the same for a entire site? How can I do it? Thank you for your help in advance! L
Technical SEO | | Chris_Wright1 -
Website is not indexing
Hi All, My website URL is https://thepeopeople.com and it is neither caching nor indexing in Google. Earlier the URL was https://peopeople.com. I have redirected it to https://thepeopeople.com by using 301 redirections. I have checked the redirection and everything else is fine and I have submitted all the URLs in search console also, still the website is not indexing. Its been more than 5 months now. Please suggest a solution for this. Thanks in Advance.
Technical SEO | | ResultfirstGA0 -
Why are only a few of our pages being indexed
Recently rebuilt a site for an auctioneers, however it has a problem in that none of the lots and auctions are being indexed by Google on the new site, only the pages like About, FAQ, home, contact. Checking WMT shows that Google has crawled all the pages, and I've done a "Fetch as Google" on them and it loads up fine, so there's no crawling issues that is standing out. I've set the "URL Parameters" to no effect too. Also built a sitemap with all the lots in, pushed to Google which then crawled them all (massive spike in Crawl rate for a couple days), and still just indexing a handful of pages. Any clues to look into would be greatly appreciated. https://www.wilkinsons-auctioneers.co.uk/auctions/
Technical SEO | | Blue-shark0 -
Https indexed...how?
Hello Moz, Since a while i am struggling with a SEO case: At the moment a https version of a homepage of a client of us is indexed in Google. Thats really strange because the url is redirected to an other website url for three weeks now. And we did everything to make clear to google that he has to index the other url.
Technical SEO | | Searchresult
So we have a few homepage urls A https://www.website.nl
B https://www.websites.nl/category
C http://www.websites.nl/category What we did: Redirected A with a 301 to B, a redirect from A or B to C is difficult because of the security issue with the ssl certificate. We put the right canonical url (VERSION C) on every version of the homepage(A,B) We only put the canonical urls in the sitemap.xml, only version C and uploaded it to Google Webmastertools We changed all important internal links to Version C We also get some valuable external backlinks to Version C Is there something i missed or i forget to say to Google hey look you've got the wrong url indexed, you have to index version C? How is it possible Google still prefers Version A after doing al those changes three weeks a go? I'am really looking forward to your answer. Thanks a lot in advanced! Greetz Djacko0 -
What to do with 302 redirects being indexed
Hi there, Our site's forums include permalinks that for some reason uses an intermediary URL that 302 redirects to the URL with the permalink anchor. For example: http://en.tradimo.com/learn/chart-analysis/time-frames/ In the comments, there is a permalink to the following URL; en.tradimo.com/co/50c450005f2b949e3200001b/ (there is no content here, and never has been). This URL 302 redirects to the following final URL: http://en.tradimo.com/learn/chart-analysis/time-frames/?offset=0&limit=20#50c450005f2b949e3200001b The problem is, Google is indexing the redirect URL (en.tradimo.com/co/50c450005f2b949e3200001b/) and showing duplicate content even though we are using the nofollow tag on these links. Ideally, we would directly use the last link rather than redirecting. Alternatively, I'd say a 301 redirect would be preferable. But if both aren't available, is there a way to get these pages out of the index? Is the canonical tag the best way? I really wish I could just add /co/ to the robots.txt file, but I think they would still be in the index, right? Thanks for your help!
Technical SEO | | etruvian0 -
Instant Indexing
I've been working on a site for a while now, methodically building content and building trust and authority. Lately I've noticed that anything I publish there appears to be instantly indexed by Google, which surprises me. I haven't had this happen before so I'm curious. I'd be interested to hear the experience of others.
Technical SEO | | waynekolenchuk0 -
Rel Canonical Question
I changed /tulsa-cleaning-services/ to /services/ because the URLs were getting too long. Now I'm getting an error for Appropriate use of Rel Canonical. I used a 301 to send old links to the new location. Any ideas? Thanks! Will www.americancarpetclean.com
Technical SEO | | WillWatrous0