Penalized and how to recover
-
Hey guys
One of our sites was penalised from a while ago and we use to rank page 1 for our keywords and now w can't be found. Is there a way to recover from this?
Also, I came across Rands video about site architecture whilst google were teaching us to generate backlinks, and spammy anchor text what would your suggestion be to recover from this? Any ideas?
Here is the site http://free-love-psychic.com/
Any suggestions?
-
It looks like your robots.txt is missing. If you upload one and Google can read it, they will crawl your site. As the message says, further crawls of your site are "postponed" until Google can read a robots.txt file (which is odd, I've never had this on sites without robots.txt before.)
I would suggest uploading & checking your robots file and then requesting a recrawl through WMT.
-
Hi Matt,
Going through google web masters tools, and finding the messages that were sent to me are as follows:
Over the last 24 hours, Googlebot encountered 30 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%.
You can see more details about these errors in Webmaster Tools.
Recommended action If the site error rate is 100%:
Using a web browser, attempt to access http://lovepsychicmary.com/robots.txt. If you are able to access it from your browser, then your site may be configured to deny access to googlebot. Check the configuration of your firewall and site to ensure that you are not denying access to googlebot. If your robots.txt is a static page, verify that your web service has proper permissions to access the file. If your robots.txt is dynamically generated, verify that the scripts that generate the robots.txt are properly configured and have permission to run. Check the logs for your website to see if your scripts are failing, and if so attempt to diagnose the cause of the failure.
If the site error rate is less than 100%:
Using Webmaster Tools, find a day with a high error rate and examine the logs for your web server for that day. Look for errors accessing robots.txt in the logs for that day and fix the causes of those errors. The most likely explanation is that your site is overloaded. Contact your hosting provider and discuss reconfiguring your web server or adding more resources to your website. If your site redirects to another hostname, another possible explanation is that a URL on your site is redirecting to a hostname whose serving of its robots.txt file is exhibiting one or more of these issues.
After you've fixed the problem, use Fetch as Google to fetch http://lovepsychicmary.com/robots.txt to verify that Googlebot can properly access your site.
So not too sure if this could be the issue?
Learn more in our Help Center.
-
There are a number of different penalties so without specifics this can be hard to answer but by far the most common we see is a partial link penalty. Basically, you built some "crap" so Google chooses to ignore it and not give you the value. Usually results in what looks like a full page, 2 page or 5+ page drop. (Keywords that were page 1 drop to 2 or 3, keywords on 2 drop to page 5, etc.)
You would need a link clean up, maybe disavow & reconsideration request if you have this (or the full link based manual penalty.) If you don't have a message in Webmasters Tools, you may also be talking about Penguin - an "algorithmic penalty" (not a true penalty.) If this is what you mean, similar steps will be taken. In either case you will also need to find a way to continue gaining authority. Disavow / recon without authority building won't get you very far.
-
Hi Alec, recovering from a Google penalty is not an easy process unfortunately. And the Q&A section here wouldn't be enough to explain everything as well. I would suggest going over this article on Moz. It is a very thorough article explaining every steps you need to take to remove manual penalties associated with your website. I hope this helps
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Loss of traffic due to domain move, not recovering
I have a new client who this year chose to eliminate using a "stronger", older domain (domain authority 50) for a newer, weaker domain (domain authority 38). The redirects actually started end of 2013 and happened over time by page/section. All were completed by Jan 12 2014. While 301 redirects are in place, and the robots.txt is disallowing all (187 pages blocked), it looks as though Google is still indexing pages (149 indexed) although not sure why. Perhaps they should be removed from the server? In spite of the redirects, they are not getting the (combined) traffic expected. Should they have had that expectation? Could it be because they are going from a "stronger", long established domain to a "weaker", newer domain, that it may take a long time to recover? They recently had another agency review the links on the weaker domain and they submitted a file to Google to disavow the links they found to be "toxic" however it doesn't seem to have made any difference, yet. Any idea how long it "should" take to make a difference, if it will indeed make a difference? They do have a blog in a sub-directory that doesn't get much traffic (approx 0.50% of the total traffic). Every post ends with a blatant self-promotion and due to Penguin, they have recently begun to mix up their link text and not include a link on every post. Last their target audience is both B-B and B-C, with B-B being priority. The big question I have is do you see changes take place with almost instant results in Google? Or am I right in telling him, this will take some time. He feels it's been almost 4 months now and their visibility/traffic should be more in par with what it was combined. Something to note is that they were sort of competing with themselves by using both domains however the number of searchers probably hasn't changed much... Thank you so much for giving me your 2 cents!
Intermediate & Advanced SEO | | cindyt-17038
xo0 -
Is it possible we are being penalized for doorway pages?
www.trophycentral.comHi, we were hit very hard a few years ago by Panda and have been try to recover. We completely revamped our site (structure, canonical, duplicates, content, etc.) and had a couple of keywords recover. However, most traffic has not comeback and still cannot be found in the top 30 pages or so for major phrases. We have compared ourselves to major competitors in our industry and see very few differences. The only thing I see as a difference is that many of our products are in multiple sections. For example, we have all baseball awards (trophies, pins, medals) grouped together. We then have just baseball medals together and just baseball pins together. Is this something that could be causing us not to rank? I am asking because the phrases that are ranking are the ones that don't have multiple categories. We have no manual penalties, but now I am thinking this is what Google might consider a doorway page?As an experiment, I just noindexed all but one category for baseball and soccer to see what happens.Does this make sense? Has anyone else seen this?Thanks!
Intermediate & Advanced SEO | | trophycentraltrophiesandawards0 -
Why Would This Old Page Be Penalized?
Here's an old page on a trustworthy domain with no apparent negative SEO activity according to OSE and ahrefs: http://www.gptours.com/Monaco-Grand-Prix They went from page 1 to page 13 for "monaco grand prix" within about 4 weeks. Week 2 we pulled out all the duplicate content in the history section. When rank slipped further, we put it back. Yet it's still moving down, while other pages on the website are holding strong. Next steps will be to add some schema.org/Event microformats, but beyond that, do you have any ideas?
Intermediate & Advanced SEO | | stevewiideman0 -
Will Google penalize a site that had many links pointing to it with utm codes?
I want to track conversions using utm parameters from guest blog posts on sites other than my own site. Will Google penalize my site for having a bunch of external articles pointing to one page with unique anchor text but utm code? e.g. mysite.com/seo-text?utm_campaign=guest-blogs
Intermediate & Advanced SEO | | wepayinc0 -
Recovering from an Automatic penalty
My website dropped from ~15 to 500 + for our main keywords in target markets (but are still doing okay in other countries and for other keywords) I cleaned my site up and contacted Google who told me no manual spam actions were taken on my site. The only thing I can think is that we suffered from an automatic penalty (the drop corresponded with a small panda update). If that is in fact what happened, how do we recover? Also feel free to contribute other ideas about what may have occurred.
Intermediate & Advanced SEO | | theLotter0 -
Penalized for duplication?
Hi there, In February 2012 one my web pages (.co.uk) dropped from page 1 to page 5 for the keyword 'Menopause' and was replaced with a .PDF Late January 2012 I launched a duplicate version of this webpage however targeting .ie due to difference currency and legalities, I had made sure in webmaster tools that both websites were both Geographically correct, I am also using hreflang tags on both webpages. One thing that is strange is if I copy the first few paragraphs of the webpage in question into Google.co.uk, it's the .ie webpage that appears. Any help would be appreciated in why this has happened. Kind Regards
Intermediate & Advanced SEO | | Paul780 -
Can you be penalized by a development server with duplicate content?
I developed a site for another company late last year and after a few months of seo done by them they were getting good rankings for hundreds of keywords. When penguin hit they seemed to benefit and had many top 3 rankings. Then their rankings dropped one day early May. Site is still indexed and they still rank for their domain. After some digging they found the development server had a copy of the site (not 100% duplicate). We neglected to hide the site from the crawlers, although there were no links built and we hadn't done any optimization like meta descriptions etc. The company was justifiably upset. We contacted Google and let them know the site should not have been indexed, and asked they reconsider any penalties that may have been placed on the original site. We have not heard back from them as yet. I am wondering if this really was the cause of the penalty though. Here are a few more facts: Rankings built during late March / April on an aged domain with a site that went live in December. Between April 14-16 they lost about 250 links, mostly from one domain. They acquired those links about a month before. They went from 0 to 1130 links between Dec and April, then back to around 870 currently According to ahrefs.com they went from 5 ranked keywords in March to 200 in April to 800 in May, now down to 500 and dropping (I believe their data lags by at least a couple of weeks). So the bottom line is this site appeared to have suddenly ranked well for about a month then got hit with a penalty and are not in top 10 pages for most keywords anymore. I would love to hear any opinions on whether a duplicate site that had no links could be the cause of this penalty? I have read there is no such thing as a duplicate content penalty per se. I am of the (amateur) opinion that it may have had more to do with the quick sudden rise in the rankings triggering something. Thanks in advance.
Intermediate & Advanced SEO | | rmsmall0 -
What has this subdomain done to recover from Panda?
I found that doctor.webmd.com was affected by Google Panda, and then recovered (if you look at traffic on compete.com). What do you think they did to recover?
Intermediate & Advanced SEO | | nicole.healthline0