De-indexed homepage in Google - very confusing.
-
A website I provide content for has just suffered a de-indexed homepage in Google (not in any of the other search engines) - all the other pages remained indexed as usual. Client asked me what might be the problem and I just couldn't figure it out - no linkbuilding has ever been carried out so clean backlink profile, etc. I just resubmitted it and it's back in its usual place, and has maintained the rankings (and PR) it had before it disappeared a few days ago. I checked WMT and no warnings or issues there. Any idea why this might've happened?
-
Having disappeared, the homepage appeared immediately when I resubmitted it, then fell back in SERPs a little and is now achieving better SERPs than when it disappeared. I can't see any probs with the code / sitemap or anything. All in all rather confusing but (thankfully) resolved in a couple of minutes. Thanks for your brilliant feedback Thomas and for your help as well Marcus. Thanks to you, I'm well prepared should this problem hit one of my clients again
-
Hi Marcus,
That is great news to have. Not that it's great that it happened but Great that other people have seen this happen and recovered. Considering all the things going on right now I would say at a glitch is entirely possible.
I know Google makes a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
Marcus very valuable contribution thank you.
a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
the 3rd link down just like Marcus explained has a very similar story. I think very valuable contribution thank you Marcus your comment inspired me to look for more data.
All the best I hope this is of help,
Thomas -
Hey, Thomas's response really nails most of the obvious causes here but as a simple n=1 oppinion this happened to one of my clients last week. Homepage disappeared for around 48 hours. No problems I could detect, but it was not indexed. Weird, but just as I was scratching my chin it popped back up.
Check the obvious things, make sure there are no problems and then leave it for 48 hours and see if it pops back up.
Not hugely scientific but after such a big update we often see little aberrations and this could be one of those if everything else is as it should be.
Hope that helps
Marcus -
I have heard a lot of people complain about page rank loss during the recent Penguin 2 update. Unfortunately that could be just Google's way of changing their own page rank. if the page itself is unaffected rank wise I would not be worried. The other thing I would what your client know is those page rank toolbars are notoriously wrong so you might want to check it through a more powerful or trustworthy source. I don't really put a lot of stock in Google's page rank because they frankly have told us not to and I would look more at the Moz rank
if there is a problem with the robots.txt it would be very possible Google is slow to reinstate it after what happened.
I would still check site with everything below however this is something I've heard of already from 2 other people. So it could just be a glitch or Google has made changes to its page rank algorithm.
It sounds to me as if there's either a problem with the robots.txt
or it's a simple matter of the plug-in or whatever's being used saying not to index or follow the homepage
if you could use this tool and simply type in the URL plus robots.txt
like this below
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
then post the results or send me a private message with them included.
In addition go on the homepage and search with either control F if you're a PC user or command F if you are Mac user for nofollow and noindex
if you find either one of these
they will look like this
http://www.robotstxt.org/meta.html
<title>...</title> you can use the
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
to change them to make sure they're not on the page. You do not need them there as Google default indexes and follows every page unless you tell it not to. The other thing you have to look for use of the X tag as well it can do the same thing as shown below
Example uses of the X-Robots-Tag
If you want to prevent search engines from showing files you’ve generated with PHP, add the following in the header file:
|
1
|header("X-Robots-Tag: noindex", true);
|This would not prevent search engines from following the links on those pages, if you want to do that, do the following:
|
1
|header("X-Robots-Tag: noindex, nofollow", true);
|But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following:
take a look at this to know if you are pages being affected by one or the other.
http://yoast.com/x-robots-tag-play/#examples
I hope this is of help,
let me know if I can be of more assistance.
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do back-links to non indexed sub-domains / sub-directories considered by Google as website backlinks and pass Pagerank to website?
Hi, If some noindexed links on our website or sub-domain got some backlinks, will that backlinks pass Pagerank / linkjuice to website? Will they be considered as backlinks to website by Google? Here is a statement from Matt cutts for the question. My question is same as below with answer? Eric Enge: Can a NoIndex page accumulate PageRank? Matt Cutts: A NoIndex page can accumulate PageRank, because the links are still followed outwards from a NoIndex page. Thanks
Algorithm Updates | | vtmoz0 -
Not showing in Google map listing. Why?
We have a client who's law firm is the highest google reviewed, on page two or three of St. Louis personal injury lawyer, but does not show in the map listing. Any ideas why this would happen or how to ensure they are viewable in the map listing?
Algorithm Updates | | David-Kley0 -
Fetch as Google - removes start words from Meta Title ?? Help!
Hi all, I'm experiencing some strange behaviour with Google Webmaster Tools. I noticed that some of our pages from our ecom site were missing start keywords - I created a template for meta titles that uses Manufacturer - Ref Number - Product Name - Online Shop; all trimmed under 65 chars just in case. To give you an idea, an example meta title looks like:
Algorithm Updates | | bjs2010
Weber 522053 - Electric Barbecue Q 140 Grey - Online Shop The strange behaviour is if I do a "Fetch as Google" in GWT, no problem - I can see it pulls the variables and it's ok. So I click submit to index. Then I do a google site:URL search, to see what it has indexed, and I see the meta description has changed (so I know it's working), but the meta title has been cut so it looks like this:
Electric Barbecue Q 140 Grey - Online Shop So I am confused - why would Google cut off some words at start of meta title? Even after the Fetch as Googlebot looks perfectly ok? I should point out that this method works perfect on our other pages, which are many hundreds - but it's not working on some pages for some weird reason.... Any ideas?0 -
Google "In-Depth Article" Question
Google started featuring "In-Depth Articles" a few days ago. You can read about them here and here. I have two questions about them... If you already hold a great position in the SERPs. Let's say your existing article ranks at #2 or #3. If that article becomes one of the "In-Depth Articles", will it disappear from the #2 or #3 position? I have lots of content that I could mark as an In-Depth Article, but I don't want to do that if it will pull me out of a hard-earned SERP position. Has anyone seen "In-Depth Articles" that do not have the Schema markup? Thanks!
Algorithm Updates | | EGOL1 -
How to keep damage low on Google after the change of URL's
Hi Peeps, Hope someone can shed a light on this and show a guidance if possible. We are going to move our sites to shopify and shopify's URL's cannot be customized to match exactly like our current URLs. What steps do I need to take so google knows the URL's are changed. Domain will be the same. Thank you in advanced.
Algorithm Updates | | cemalcebi0 -
Penguine 2.0 Confusion
I am getting seriously confused over our rankings and am hoping someone can give me a bit of clarity. When Penguin 2.0 hit last week we saw a drop of between 2 – 6 places on seven out of a set of around a dozen key phrases I monitor. We had been in the number 1 / 2 position for the majority of them over the last year – 18 months, and this drop has reduced our traffic by around 30 – 35%. I have looked at our back link profile - http://www.opensiteexplorer.org/links?site=www.wombatwebdesign.com%2F, and I don’t think it is that bad. Being a web design company the vast majority, 80% of the links are from the footer of client sites. We have a small, 5% number of links from comments; a similar amount of dead links and the rest are made up of the usual, profile, directory and article links. I was wondering if the way we link from client sites could be an issue, we link twice, once with the anchor text (Web Design Cumbria) and the second link is our company branding (Wombat Web Design, with the title tag – Web Design Cumbria). Could this be causing a problem? If anyone could point me in the right direction I would be most grateful. Thanks Fraser
Algorithm Updates | | fraserhannah1 -
Why would my keywords never ranking in Bing but have great position in both Google and Yahoo?
I have several keywords ranking top 5 for Google and Yahoo but nothing from Bing. Any ideas?
Algorithm Updates | | CIEEwebTeam0 -
When did the New Google Algorithm Come into Force in the UK
On March 3rd, the hits on my UK site crashed to 40% of the previous number. I am guessing it may be down to the google algorithm change:- http://wisestartupblog.com/seo/google-algorithm-change-february-2011-losers-winners/5081 However, I am aware this happened on 25th Feb in the US. Do you know when it happened in the UK. Could it have suddenly started affecting me on March 3?
Algorithm Updates | | MattBB121