De-indexed homepage in Google - very confusing.
-
A website I provide content for has just suffered a de-indexed homepage in Google (not in any of the other search engines) - all the other pages remained indexed as usual. Client asked me what might be the problem and I just couldn't figure it out - no linkbuilding has ever been carried out so clean backlink profile, etc. I just resubmitted it and it's back in its usual place, and has maintained the rankings (and PR) it had before it disappeared a few days ago. I checked WMT and no warnings or issues there. Any idea why this might've happened?
-
Having disappeared, the homepage appeared immediately when I resubmitted it, then fell back in SERPs a little and is now achieving better SERPs than when it disappeared. I can't see any probs with the code / sitemap or anything. All in all rather confusing but (thankfully) resolved in a couple of minutes. Thanks for your brilliant feedback Thomas and for your help as well Marcus. Thanks to you, I'm well prepared should this problem hit one of my clients again
-
Hi Marcus,
That is great news to have. Not that it's great that it happened but Great that other people have seen this happen and recovered. Considering all the things going on right now I would say at a glitch is entirely possible.
I know Google makes a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
Marcus very valuable contribution thank you.
a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
the 3rd link down just like Marcus explained has a very similar story. I think very valuable contribution thank you Marcus your comment inspired me to look for more data.
All the best I hope this is of help,
Thomas -
Hey, Thomas's response really nails most of the obvious causes here but as a simple n=1 oppinion this happened to one of my clients last week. Homepage disappeared for around 48 hours. No problems I could detect, but it was not indexed. Weird, but just as I was scratching my chin it popped back up.
Check the obvious things, make sure there are no problems and then leave it for 48 hours and see if it pops back up.
Not hugely scientific but after such a big update we often see little aberrations and this could be one of those if everything else is as it should be.
Hope that helps
Marcus -
I have heard a lot of people complain about page rank loss during the recent Penguin 2 update. Unfortunately that could be just Google's way of changing their own page rank. if the page itself is unaffected rank wise I would not be worried. The other thing I would what your client know is those page rank toolbars are notoriously wrong so you might want to check it through a more powerful or trustworthy source. I don't really put a lot of stock in Google's page rank because they frankly have told us not to and I would look more at the Moz rank
if there is a problem with the robots.txt it would be very possible Google is slow to reinstate it after what happened.
I would still check site with everything below however this is something I've heard of already from 2 other people. So it could just be a glitch or Google has made changes to its page rank algorithm.
It sounds to me as if there's either a problem with the robots.txt
or it's a simple matter of the plug-in or whatever's being used saying not to index or follow the homepage
if you could use this tool and simply type in the URL plus robots.txt
like this below
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
then post the results or send me a private message with them included.
In addition go on the homepage and search with either control F if you're a PC user or command F if you are Mac user for nofollow and noindex
if you find either one of these
they will look like this
http://www.robotstxt.org/meta.html
<title>...</title> you can use the
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
to change them to make sure they're not on the page. You do not need them there as Google default indexes and follows every page unless you tell it not to. The other thing you have to look for use of the X tag as well it can do the same thing as shown below
Example uses of the X-Robots-Tag
If you want to prevent search engines from showing files you’ve generated with PHP, add the following in the header file:
|
1
|header("X-Robots-Tag: noindex", true);
|This would not prevent search engines from following the links on those pages, if you want to do that, do the following:
|
1
|header("X-Robots-Tag: noindex, nofollow", true);
|But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following:
take a look at this to know if you are pages being affected by one or the other.
http://yoast.com/x-robots-tag-play/#examples
I hope this is of help,
let me know if I can be of more assistance.
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Non-indexed or indexed top hierarchy pages get high PageRank at Google?
Hi, We are creating some pages just to capture leads from blog-posts. We created few pages at top hierarchy like website.com/new-page/. I'm just wondering if these pages will take away more PageRank. Do we need to create these pages at low hierarchy like website.com/folder/new-page to avoid passing more PageRank? Is this is how PR distributed even now and it's same for indexed or non-indexed pages? Thanks
Algorithm Updates | | vtmoz0 -
Tens of duplicate homepages indexed and blocked later: How to remove from Google cache?
Hi community, Due to some WP plugin issue, many homepages indexed in Google with anonymous URLs. We blocked them later. Still they are in SERP. I wonder whether these are causing some trouble to our website, especially as our exact homepages indexed. How to remove these pages from Google cache? Is that the right approach? Thanks
Algorithm Updates | | vtmoz0 -
Drop in Traffic from Google, However no change in the rankings
I have seen a 20% drop in traffic from google last week (After April 29th). However when I try to analyze the rank of the keywords in the google results that send me traffic they seem to be the same. Today (6th March) Traffic has fallen further again with not much/any visible change in the rankings. Any ideas on what the reason for this could be? I have not made any changes to the website recently.
Algorithm Updates | | raghavkapur0 -
Same page but appearing in Google with different titles
I have a page ranking on position 1 for a key phrase. The key phrase is the title of the page as well. I'll use a mock key phrase to aid my question - "Teeth and Gums" So the page is ranking number 1 for "Teeth and Gums" and "Teeth and Gums" is the meta title. However, I went ahead and did a new search adding an additional keyword to the original search. When I did a new search adding an additional keyword to the original search, Google has done something weird.. Let's say the search is "Dentistry - Teeth and Gums", Google has ranked my page again as number 1 but changed the title. The title in the search result is now "Dentistry - Teeth and Gums" How and why? It's kinda like Google PPC's keyword insertion but the title hasn't got anything weird like {KeyWord: Dentistry}. It's just "Teeth and Gums" Has this happened to you guys? Any ideas?
Algorithm Updates | | Bio-RadAbs0 -
Has there been a Google change in the last 24 hours?
We have come in this morning to find our site (paydayuk.co.uk) has suddenly disappeared from their SERPs, we have consistently been ranking in the top 5 for a wide range of search terms but now do not even appear for our brand name of Payday UK where we have been first for many months. Our site is still indexed and we have made no changes for a while as any SEO work is waiting on completion of a CMS system. Looking in https://groups.google.com/a/googleproductforums.com/forum/#!categories/webmasters/crawling-indexing--ranking and there seem to be a lot of people having the same issues but as of yet no answers. I'd also like to add we don’t use black hat techniques so we really don’t understand why we have been penalised. Can anyone help please?
Algorithm Updates | | Sarbs0 -
Google new update question
I was just reading this, http://www.entrepreneur.com/blog/220662 We have our official site, which has 200+ service pages, which we wrote once and we keep doing SEO for them, so they rank high all the time. Now my question is, how does Google handle the site freshness ? Service static pages or if we are adding blog items, then also they consider them as fresh site, right ? So, we dont have to update those service pages, right ?
Algorithm Updates | | qubesys0 -
How To Rank High In Google Places?
Hello SEOmoz, This question has been hounding me for a long time and I've never seen a single reliable information from the web that answers it. Anyway here's my question; Supposing that there are three Google places for three different websites having the same categories and almost same keywords and same district/city/IP how does Google rank one high from the other? Or simply put if you own one of those websites and you would want to rank higher over your competitors in Google places Search results how does one do it? A number of theories were brought up by some of my colleagues: 1. The age of the listing 2. The number of links pointing to the listing (supposing that one can build links to ones listing) 3. The name/url of the listing, tags, description, etc. 4. The address of the listing. 5. Authority of the domain (linked website) You see some listings have either no description, and only one category and yet they rank number one for a specific term/keyword whereas others have complete categories, descriptions etc. If you could please give me a definite answer I will surely appreciate it. Thank you very much and more power!
Algorithm Updates | | LeeAnn300 -
Working in the world of Google Farmer Update
So I know have seen how my websites have taken a nose dive from the google farmer update most likely with traffic significantly hit. Example site is callcatalog.com. What recommendations are there to deal with the new world order? How can we look at optimizing, changing, modifying our process to improve rankings and traffic?
Algorithm Updates | | seo_ploom0