De-indexing and SSL question
-
Few days ago Google indexed hundreds of my directories by mistake (error with plugins/host), my traffic dropped as a consequence.
Anyway I fixed that and submitted a URL removal request. Now just waiting things to go back to normality.
Meantime I was supposed to move my website to HTTPS this week.
Question:
Should I wait until this indexing error has been fixed or I may as well go ahead with the SSL move?
-
Let me know if you can let me see the domain?
-
PS I agree it would be nice to hear from more people I am sure you will by tomorrow.
-
I respect your want to get this right
“A few days ago, Google indexed hundreds of my directories by mistake (error with plugins/host); my traffic dropped as a consequence.
_ Anyway, I fixed that and submitted a URL removal request. Now just waiting for things to go back to normality.” _
in my opinion, you can see the change happen to the https URLs & you want to be sure that https will not let your unwanted directory back in Google's index.
I think unless you can show me your site better Search & replace will be more comfortable & faster.
Yes, I have used better search & replace many times; it’s a great tool.
Make sure you back up your site before you do a search & replace.
https://wordpress.org/plugins/better-search-replace/
I think you should be able to see everything needed and more from this great how-to the person who made it is a friend & they don't just show you how to do this on Kinsta they show you how to use Apache & Nginx as well.
It covers everything you might want to think about managed wordpress hosting if this is something you don't feel comfortable doing.
https://kinsta.com/blog/http-to-https/
I would look at Pagely, Pantheon Servebolt & Kinsta.
If it helps, I am ranked in the top 10 or 11 for assisting people on Moz. Unless you only blocked the HTTP version of your directories, then you will have the same results with https.
- Would you allow me to see the domain?
- Who is your hosting company?
Respectfully,
Tom Zickell
-
Hi Tom,
yes I have WordPress, I have read a few guides online about it.for the search and replace part, I found a plugin called Better Search Replace: https://www.wpbeginner.com/wp-tutorials/how-to-add-ssl-and-https-in-wordpress/
the instructions in the search engine journal article do the search-replace manually. The plugin should be better, have you tried it?
Good question. In all honesty, I think it's safe to go forward with an HTTPS migration.
I am a bit worried. I asked this question to many people in many forums and nobody replies. Which makes me wonder if it's something really bad. It would be nice to have additional opinions.
-
Good question. In all honesty, I think it's safe to go forward with an HTTPS migration.
A "URL removal request"
A simple move to https two different things that can be done at the same time.
if you have a certain set up please let me know I can give you better instructions on how to completely migrate over to HTTPS. Here are some of the basics below.
- https://www.searchenginejournal.com/https-migration-guide/195103/
- https://www.keycdn.com/blog/http-to-https
- https://gofishdigital.com/steps-in-website-https-migration/
if you're using WordPress
- https://www.searchenginejournal.com/wordpress-http-to-https/236969/
- Photograph https://imgur.com/q1RfhhH.jpg
Search & Replace in Files
To begin, search for instances of your domain pointing to HTTP URLs of your site.
Use the regex for **“www” **and without “www” URL cases and search for
http:\/\/(www\.)?yourdomain\.com
always search and replace your database if you have one.
remember to implement redirects
NGINX
Add the following to your Nginx config.
<code class=" language-nginx">server { listen 80; server_name domain.com www.domain.com; return 301 https://domain.com$request_uri; }</code>
Apache
Add the following to your
.htaccess
file.<code class=" language-apacheconf">RewriteEngine On RewriteCond %{HTTPS} off RewriteRule (.*) https://%{HTTP_HOST}%{REQUEST_URI} [R=301,L]</code>
6. Update your robots.txt File#
Update any hard-coded links or blocking rules you might have in your
robots.txt
that might still be pointing to HTTP directories or files- Update your robots.txt file
- Update your disavow file if you have one
- update Google search console
if you want a very quick easy way to implement HTTPS, redirects as well as certificates I recommend Cloudflare The free version should do it.
-
I hope this helps,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirect indexed lightbox URLs?
Hello all, So I'm doing some technical SEO work on a client website and wanted to crowdsource some thoughts and suggestions. Without giving away the website name, here is the situation: The website has a dedicated /resources/ page. The bulk of the Resources are industry definitions, all encapsulated in colored boxes. When you click on the box, the definition opens in a lightbox with its own unique URL (Ex: /resources/?resource=augmented-reality). The information for these colored lightbox definitions is pulled from a normal resources page (Ex: /resources/augmented-reality/). Both of these URLs are indexed, leading to a lot of duplicate indexed content. How would you approach this? **Things to Consider: ** -Website is built on Wordpress with a custom theme.
Technical SEO | | Alces
-I have no idea how to even find settings for the lightbox (will be asking the client today).
-Right now my thought is to simply disallow the lightbox URL in robots.txt and hope Google will stop crawling and eventually drop from the index.
-I've considered adding the main resource page canonical to the lightbox URL, but it appears to be dynamically created and thus there is no place to access (outside of the FTP, I imagine?). I'm most rusty with stuff like this, so figured I'd appeal to the masses for some assistance. Thanks! -Brad0 -
Any idea why pages are not being indexed?
Hi Everyone, One section on our website is not being indexed. The product pages are, but not some of the subcategories. These are very old pages, so thought it was strange. Here is an example one one: https://www.moregems.com/loose-cut-gemstones/prasiolite-loose-gemstones.html If you take a chunk of text, it is not found in Google. No issues in Bing/Yahoo, only Google. You think it takes a submission to Search Console? Jeff
Technical SEO | | vetofunk1 -
Bing rankings question
Hi, We just wrapped up a website redesign about a month ago. The content stayed primarily the same. Once we launched the new site all of our rankings in Google stayed the same but we lost rank for all competitive keywords on Bing. I looked in Bing Webmaster tools and it doesn't show any penalties but it does show that we have too many H1 tags. I don't think the H1 tag thing is the issue but maybe. Do you know what could be causing this?
Technical SEO | | BT20090 -
Why wont google Index this page?
A week ago i accidentally changed this page settings in my CMS to "disable & dont index" as i was going to replace this page with another, but this didnt happen, but i forgot to switch the settings back! http://www.over50choices.co.uk/funeral-planning/funeral-plans Anyhow in an effort to get it back up quickly i submitted in GWTs but its still not indexed. When i use several SEO on page checking tools it has the Meta Title data as "Form" and not the correct title. Any ideas please? Yours frustrated Ash
Technical SEO | | AshShep10 -
Canonical Expert question!
Hello, I am looking for some help here with an estate agent property web site. I recently finished the MoZ crawling report and noticed that MoZ sees some pages as duplicate, mainly from pages which list properties as page 1,2,3 etc. Here is an example: http://www.xxxxxxxxx.com/property-for-rent/london/houses?page=2
Technical SEO | | artdivision
http://www.xxxxxxxxx.com/property-for-rent/london/houses?page=3 etc etc Now I know that the best practise says I should set a canonical url to this page:
http://www.xxxxxxxxx.com/property-for-rent/london/houses?page=all but here is where my problem is. http://www.xxxxxxxxx.com/property-for-rent/london/houses?page=1 contains good written content (around 750 words) before the listed properties are displayed while the "page=all" page do not have that content, only the properties listed. Also http://www.xxxxxxxxx.com/property-for-rent/london/houses?page=1 is similar with the originally designed landing page http://www.xxxxxxxxx.com/property-for-rent/london/houses I would like yoru advise as to what is the best way to can url this and sort the problem. My original thoughts were to can=url to this page http://www.xxxxxxxxx.com/property-for-rent/london/houses instead of the "page=all" version but your opinion will be highly appreciated.0 -
WordPress post indexation speed
Has anyone noticed any increases in the length of time it takes for WP posts to get indexed by Google? I have a website with the following: domain.com - CMS with lots of pages/content blog.domain.com - subdomain for the blog using WP It's odd.. the pages on the main site are indexed almost immediately. The posts on the blog are taking between 2-5 days. The blog posts are all unique content, here's an example of a recent one: blog.looksfishy.co.uk/2013/three-rivers-angling/
Technical SEO | | edwardlewis0 -
Domain restructure, sitemaps and indexing
I've got a handcoded site with around 1500 unique articles and a handcoded sitemap. Very old school. The url structure is a bit of a mess, so to make things easier for a developer who'll be making the site database-driven, I thought I'd recategorise the content. Same content, but with new url structure (I thought I'd juice up the urls for SEO purposes while I was at it) To this end, I took categories like: /body/amazing-big-shoes/
Technical SEO | | magdaknight
/style/red-boots/
/technology/cyber-boots/ And rehoused all the content like so, doing it all manually with ftp: /boots/amazing-boots/
/boots/red-boots/
/boots/cyber-boots/ I placed 301 redirects in the .htaccess file like so: redirect 301 /body/amazing-boots/ http://www.site.co.uk/boots/amazing-boots/ (not doing redirects for each article, just for categories which seemed to make the articles redirect nicely.) Then I went into sitemap.xml and manually overwrote all the entries to reflect the new url structure, but keeping the old dates of the original entries, like so: <url><loc>http://www.site.co.uk/boots/amazing-boots/index.php</loc>
<lastmod>2008-07-08</lastmod>
<changefreq>monthly</changefreq>
<priority>0.5</priority></url> And resubmitted the sitemap to Google Webmasters. This was done 4 days ago. Webmaster said that the 1400 of 1500 articles indexed had dropped to 860, and today it's climbed to 939. Did I adopt correct procedure? Am I going about things the right way? Given a little time, can I expect Google to re-index the new pages nicely? I appreciate I've made a lot of changes in one fell swoop which could be a bit of a no-no... ? PS Apologies if this question appears twice on Q&A - hopefully I haven't double-posted0 -
Continued Lack of Google Indexing
I run a baseball site (http://www.mopupduty.com) that is in a very good link neighbourhood. ESPN, The Score, USA Today, MSG Network, The Toronto Star, Baseball Prospectucs, etc etc. New content has not been getting indexed on Google ever since the last update. Site has no dup content, 100% original. I can't think of any spammy links, we get organic links day after day. In the past Google has indexed the site in minutes. It currently has expanded site links within Google search. Bing & Yahoo index the site in minutes. Are there any quick fixes I can make to increase my chance to get indexed by Google. Or just keep pumping out content and hope to see a change in the upcoming future?
Technical SEO | | mkoster1