De-indexed homepage in Google - very confusing.
-
A website I provide content for has just suffered a de-indexed homepage in Google (not in any of the other search engines) - all the other pages remained indexed as usual. Client asked me what might be the problem and I just couldn't figure it out - no linkbuilding has ever been carried out so clean backlink profile, etc. I just resubmitted it and it's back in its usual place, and has maintained the rankings (and PR) it had before it disappeared a few days ago. I checked WMT and no warnings or issues there. Any idea why this might've happened?
-
Having disappeared, the homepage appeared immediately when I resubmitted it, then fell back in SERPs a little and is now achieving better SERPs than when it disappeared. I can't see any probs with the code / sitemap or anything. All in all rather confusing but (thankfully) resolved in a couple of minutes. Thanks for your brilliant feedback Thomas and for your help as well Marcus. Thanks to you, I'm well prepared should this problem hit one of my clients again
-
Hi Marcus,
That is great news to have. Not that it's great that it happened but Great that other people have seen this happen and recovered. Considering all the things going on right now I would say at a glitch is entirely possible.
I know Google makes a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
Marcus very valuable contribution thank you.
a change to the page rank algorithm approximately every 3 months and weird things happen. Plus if you count the way people actually charge their page rank it's normally with some bar that's out of date.
Here, it is what I found it appears to be extremely common with no issues that would actually affect you like your SERPS rank for certain keywords.
http://productforums.google.com/forum/#!topic/webmasters/ffzgDbpHh14
http://www.search9.co.uk/why-has-my-pagerank-disappeared
http://www.webworkshop.net/google_faq.html
http://www.webmasterworld.com/google/4550136-3-30.
http://www.zemanta.com/blog/find-google-algorithm-updates-make-website-search-rank-drop/
the 3rd link down just like Marcus explained has a very similar story. I think very valuable contribution thank you Marcus your comment inspired me to look for more data.
All the best I hope this is of help,
Thomas -
Hey, Thomas's response really nails most of the obvious causes here but as a simple n=1 oppinion this happened to one of my clients last week. Homepage disappeared for around 48 hours. No problems I could detect, but it was not indexed. Weird, but just as I was scratching my chin it popped back up.
Check the obvious things, make sure there are no problems and then leave it for 48 hours and see if it pops back up.
Not hugely scientific but after such a big update we often see little aberrations and this could be one of those if everything else is as it should be.
Hope that helps
Marcus -
I have heard a lot of people complain about page rank loss during the recent Penguin 2 update. Unfortunately that could be just Google's way of changing their own page rank. if the page itself is unaffected rank wise I would not be worried. The other thing I would what your client know is those page rank toolbars are notoriously wrong so you might want to check it through a more powerful or trustworthy source. I don't really put a lot of stock in Google's page rank because they frankly have told us not to and I would look more at the Moz rank
if there is a problem with the robots.txt it would be very possible Google is slow to reinstate it after what happened.
I would still check site with everything below however this is something I've heard of already from 2 other people. So it could just be a glitch or Google has made changes to its page rank algorithm.
It sounds to me as if there's either a problem with the robots.txt
or it's a simple matter of the plug-in or whatever's being used saying not to index or follow the homepage
if you could use this tool and simply type in the URL plus robots.txt
like this below
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
then post the results or send me a private message with them included.
In addition go on the homepage and search with either control F if you're a PC user or command F if you are Mac user for nofollow and noindex
if you find either one of these
they will look like this
http://www.robotstxt.org/meta.html
<title>...</title> you can use the
http://www.internetmarketingninjas.com/seo-tools/robots-txt-generator/
to change them to make sure they're not on the page. You do not need them there as Google default indexes and follows every page unless you tell it not to. The other thing you have to look for use of the X tag as well it can do the same thing as shown below
Example uses of the X-Robots-Tag
If you want to prevent search engines from showing files you’ve generated with PHP, add the following in the header file:
|
1
|header("X-Robots-Tag: noindex", true);
|This would not prevent search engines from following the links on those pages, if you want to do that, do the following:
|
1
|header("X-Robots-Tag: noindex, nofollow", true);
|But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following:
take a look at this to know if you are pages being affected by one or the other.
http://yoast.com/x-robots-tag-play/#examples
I hope this is of help,
let me know if I can be of more assistance.
Thomas
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google inaccurate results: Common or error?
Hi all, While searching for our primary keyword, I can see 2 websites on second page results which are non-related to the keyword or industry but their company name is this keyword. Like if I want to rank and searching for "SEO", there are 2 websites which called "seo trucks" and "seo paints". I wonder how Google is ranking these websites for high competition keyword with 1 million searches per month. So the keyword in URL and this keyword mentioned across the website being their brand name taking over the other potential ranking factors like backlinks, relevant content, user clicks, etc..... Thanks
Algorithm Updates | | vtmoz0 -
Google's Presentation Yesterday
We hired a new website/marketing company that is a Preferred Google Partner (one of two in Charlotte according to them) and they hosted a presentation by Google at the Google Fiber office in Charlotte yesterday. As expected, there were lots of self-promotion by Google, accompanied with a plethora of data they created to support their PPC Marketing. It was an impressive performance with Molly Dince and Celena Fergusson, presenting Google Marketing Solutions: "Making the Web Work For You" and the keynote speaker Tim Reis, Director of Performance Agencies at Google: speaking on "Mobile Micromoments: Why Your Biggest Opportunities Are In The Smallest Moments" They ended with 15 minutes of Q&A and my question was answered with "I don't know" which I found surprising. So, here it is Thursday morning and I'm asking the same question to my Moz Family for some feedback: "Since the removal of Ads from the right column of a SERP, what percentage of Google traffic comes from Ads vs. the Organics?" I look forward to your comments. TY,
Algorithm Updates | | KevnJr
KJr0 -
Google Panda July 2016
Hi Does anyone know what impact the recent slow Panda roll out may have? Obviously content, but would it perhaps include engagement/user behaviour factors regarding your on page content too? Thanks
Algorithm Updates | | BeckyKey0 -
What Ranking Factors Impact Google News Visibility?
I'm just at the beginning of a new analysis involving Google News visibility and ranking factors, and thought I could put the project out to you, dear SEO geniuses, to get your ideas and perspectives. Backgrounder: My company operates over 50 niche, disease-specific daily news sites, covering science, research and advocacy news about specific diseases. Virtually all of them are in Google News. They range in age from 3 years old to 3 months old. Varying degrees of page rank / authority Content on the site is completely niche to specific diseases, and we have a lot of sites for rare and orphan diseases. Most of the content is news, but we also have info/resources pages, blogs, and some short-form posts made for use in social media. The Project: I want to do an analysis of keywords in our news headlines and see how certain keywords correlate with articles that do well -- both in terms of search traffic and overall with users. Going to use our Multiple Sclerosis News Today website. Most of our search traffic comes from Google News. What I hope to gain: I'm curious to see if certain sets of keywords that relate to the disease, to therapies, etc. drive the most traffic. I want to compare these keyword lists to how well we rank in organic search for the same keywords (via news articles or info pages) to see if there is a connection. I want to also create a working keyword list of the best-performing keywords in the news as a way of cross-pollinating content production on our blogs, info pages, social content, etc. I want to increase my knowledge base of ranking factors specific for Google News. The last point is really something I wish I knew more about. I feel like there aren't many knowledge resources out there about Google News. Is it safe to assume that the same on-site and off-site SEO best practices that govern organic search engine visibility are at play in Google News, or are there independent factors as well? I'd love to get your thoughts. Thanks!
Algorithm Updates | | Michael_Nace0 -
Google update January 2015
Hello, In January 2015, google changed its European Algorithm. The change decreased the ranking of some of our keywords but not all. See article for more evidence in google changing its algorithm. https://www.seroundtable.com/google-update-maybe-19760.html The biggest change was the keyword phrase ‘Wholesale Silver Jewellery’ which we ranked 1 in SERP, but now we’re nowhere to be seen. However, the change didn’t affect our keyword phrase ‘Wholesale Jewellery Silver’, ’Wholesale Silver’ and ‘Wholesale Jewellery. We’ve been through our data and see that all of our ’Silver Jewellery’ keyword phrases are no longer showing in the SERP. Further research has shown that our competitors were also dropped down the rankings for the same keyword phrase. Our question is: Why has this update affected certain keyword phrases, such as ‘silver jewellery’ but not ‘jewellery silver’ and how should we over come this? Additional Information
Algorithm Updates | | SilverStar1
If you type in our company name ‘Mainly Silver’ or ‘mainlysilver’ were still showing in SERP, however if you type ‘mainlysilver jewellery’ we’re no where to be found. We’ve even checked ‘site:mainlysilver.co.uk silver jewellery’ in google search and it returns with ‘no results found’. If you switch the keyword phrase, all our web pages are showing up Our website is - www.mainlysilver.co.uk0 -
Is Google Rotating Good Matches?
I have a theory that Google may be trying to be fair to white-hat-seo sites that are doing the right things with blogging, linking, social media, etc. [ie that deserve equal good positioning] are being cycled to and from the first page, perhaps in a weekly or monthly basis. My theory would be that they are purposefully doing it to give those sites more equal exposure. My case: I've had top rankings for http://thedogbitelawyer.com for almost all of the important terms for dog bite lawyers for a couple of years now. When Penguin came out we lost some ground across the board, and identified that perhaps there was too much duplicate content left over from when I inherited the site. I reworked the site wording and link structure a bit and gained back positioning. Since that time we are up and down like a yo-yo on the top terms! Anybody else have this suspicion? If it's true, I don't need to stress, if we are bouncing around for other reason's I'd better keep stressing!
Algorithm Updates | | JCDenver0 -
Rankings changing every couple of MINUTES in Google?
We've been experiencing some unusual behaviour in the Google.co.uk SERPs recently... Basically, the ranking of some of our websites for certain keywords appears to be changing by the minute. For example, doing a search for "our keyword" might show us at #20. Then a few minutes later, doing the same search shows us at #14, and then the same search a few minutes later shows us at #26, and then sometimes we're not ranked at all, etc etc. I know the algorithm changes a lot, but does it really change every couple of minutes? Has anyone else experienced this kind of behaviour in the SERPs? What could be causing it to happen?
Algorithm Updates | | d4online0 -
Do we have a timeline of google, bing updates
I thought it would be handy if we had a timeline with dates of any updates to the algo's.
Algorithm Updates | | AlanMosley
Does one exists here at SEOMoz or elsewhere.
Thanks3