Google launches their Disallow Tool
-
-
Hi Irving,
Today i have Compiled a comprehensive backlink report for one of my hotel client (http://www.fairfieldinnhotelcedarrapids.com/).I have identified all bad links and create one .txt file and upload via google disallow tool. now my question is, How do i know that all dead links has been removed? Is there any way to know status?
Thanks
-
If you Disavowed "good" links to your site, your rankings may be lowered as a result.
If you Disavowed "bad" links, then your Penguin issue could be reduced or resolved.
The best course of action is to allow a trained SEO professional examine each linking domain to determine if the links violate Google's Guidelines and only Disavow the links which do violate those guidelines. Also, the Disavow tool should not be used until after every possible action has been taken to remove the link. Google is quite clear on this topic. If you use the Disavow tool without "significantly" reducing the manipulative links to your site, it likely will not help.
-
I admit it... I panicked and disavowed a ton of domains that I didn't recognize as good links and I went from mid-page-2 to lower-page-3. So...my question is: what happens if I submit a new disavow file that has only a fraction of the links. Or, better yet, what if I delete the disavow file altogether with a file that has a comment saying Oops, sorry, we didn't know what we were doing with this tool and respectfully request to undo our mess".
A very good SEO told me to not chase after my disavow list, and I get what he's saying, but it's hard to not remember the days pre-disavow when I was at least on page 2 ... I was on page 1 for 14 years since 1998 until penguin hit! (I sell bean bag chairs and am speaking of serps for "bean bag chairs").
www.ahhprods.com in case anyone is curious
Thanks!
-
So far my webmaster response is about 10%, so you have no idea how much this tool can relieve some pain after so many attempts.
To the best of my knowledge, the Disavow Tool will have absolutely no impact on your success rate. It seems designed to help ensure webmasters who have a manual penalty lifted are not affected by Penguin.
-
This is gonna be interesting how everything works out.
I've sent a reconsideration request a day or two prior to the release. I will see how that request goes and then update the spreadsheet with new links I've removed as well as using disavow.
So far my webmaster response is about 10%, so you have no idea how much this tool can relieve some pain after so many attempts.
-
The damage was done before i came on the picture and there is no stats from before. the site rangs below other sites owned by the same clent with much weaker linking profiles. As i mentioend the site has the best of links, this is why i am prepared to get rid of any links that look even the slightest doggy. The site should rank number 1 when you look at the competition
I just dont have the time or budget to try to ask for removal, a attemp was made long ago with no sucess.
-
Very busy with a new project out of Arizona.
i have been following Mitt closely. He might just get over the line.
-
-
Thanks... Should have read the YouTube description.
-
This says to me that your site was spared an across the board penalty, but your rankings for specific keywords that have been overused in your anchor text have been suppressed. I would look at your incoming link anchor texts and see which one(s) you are no longer ranking for.
-
Excellent sir.
We will know pretty soon how everything shakes out once people start reporting back, but my suggestion would be that if you have a site that is not penalized you should NOT use this tool as an effort to try and clean up any spammy back links and clean up your good-to-bad backlink ratio. The reason is, this is a tool to be used as a last effort in trying to come back from a penalty when there are some links you tried to remove but simply cannot.
Sending this report will put eyeballs on your site and bring unnecessary attention to your site. Why ask Google to review your backlink profile and look at the nastiest links pointing to your site if your site is currently healthy.
An exception to this rule I think would be if you notice you are clearly under a negative SEO attack. Then it would make sense to be proactive.
-
Very solid analysis Ryan, good stuff.
-
Long time comming and quiite a messy interface. why they could not do somthing like Bing did with there tool is a mystery.
I have a client with a unatural link warning, saying "for this specific incident we are taking very targeted action on the unnatural links instead of your site as a whole"
to me this sounds like these links have been discounted anyhow and that the site is not punished, and maybe no need to do anything, but then goes on to say "If you are able to remove any of the links, please submit a reconsideration request, including the actions that you took."
so that makes me think i do need to do something. not very clear.
This client has a lot of very good links from CNN, NYT and a host of others, but partisipated in a link wheel. The blogs in this link wheel are real blogs rather than your obvious mass made for links blogs and makes it hard to identify what are what. i am thinking to disavow anything thats could be doggy, he has such good links I think it better to have a few false positives rather then leave any bad links in the profile.
Back to my first point, i was hoping for a click and job done approch link in BWMT.
-
Nice write-up Ryan, thanks.
Looks like an aggressive tool, I can see a lot of Webmasters running into trouble with this one.
If you contact a blog to get a link removed and then realise after actually I have made a mistake, or you login to a directory and remove it yourself and realise after you have made a mistake you can work on getting it back.
I get the feeling if you don't go through the process Ryan put down and you make a mistake with the Disallow Tool you wont be able to get those links back.
-
You are so right Ryan! This tool is not a shortcut at all. I fear that a lot of webmasters who have an unnatural links warning are going to jump straight to the disavow tool and ignore the actual reconsideration request process. As Matt says in the video, you still need to make a thorough attempt at trying to get the links removed on your own in order to have a manual penalty revoked.
-
Thanks for opening this discussion Irving. I have had calls from clients today regarding this "change" and it seems many site owners are simply caught up in the idea without realizing the true impact of this change. Resolving a manual Google penalty for manipulative links involves 4 steps prior to the release of this tool:
1. Compile a comprehensive backlink report. Many sites which suffer from a manipulative link penalty are absolutely doomed to have their Reconsideration Requests declined before they are even submitted. Why? Because they have not captured all the links to their site. You cannot rely on any single tool or even 2 tool combination. For each client I work with we compile a list of every known backlink to their site. How? By combining Google + Bing + OSE + Majestic + AHREFs data. Each data source offers links the others do not seem to find.
2. Properly identify all the manipulative links to the target site. Once again, many site owners repeatedly fail their Reconsideration Request and have no real chance at success because they try to take the easy way out. Attempting to replace real effort with fake work is what caused the penalty in the first place.
a. A thorough understanding of the difference between an organic link and manipulative link is required. In short, you must calibrate your understanding of links to match Google. How do you view free directory links? The reality is 99%+ of them are manipulative. How about press releases? Do you think most press releases are organic links? When site owners pay another company to publish articles they wrote with links back to their site, does that sound natural to you?
b. How about broken links? Can you use an automatic link checker and then if the link is not on the URL simply cross it off the list? In a significant percent of cases the link has simply moved to another page on the linking site. Some sites have very dynamic link structures where one day a URL is at ?page=20 and the next it is at ?page=21. Other sites make URL changes over time. You must search each site using their search widget and a Google site: search before assuming the site's link is gone.
c. Is the link marked NoFollow? You need to keep searching the page to ensure there are not other followed links on the same page.
The above are just some examples of gaps in the process of many who attempt to resolve this type of penalty. The disavow tool's introduction does not impact this step.
3. Webmaster Outreach. Once you have a comprehensive list of all known links to your site and have properly identified all the manipulative links, there is a need to contact every site on the list. Another common issue is those attempting to resolving a manipulative link issue give up far too easy. Site owners can be contacted via their WHOIS email address, the email address on their site AND the contact form on their site. You can call them, send a letter and chase them down on social networks. This type of sincere effort can lead to 50%+ reduction in links to your site.
Once sincere and comprehensive efforts have been made to remove the links, Google can clearly tell because there will be a "significant" reduction in manipulative links. At that point, THEN the Disavow tool can be used.
4. Filing a thoroughly documented Reconsideration Request. Three days later, the Reconsideration Request can be submitted.
So the introduction of this tool actually did not reduce any step in the process at all. Matt clearly outlined Google's expectation the tool is only used after a webmaster outreach campaign has been completed. If you expect to be able to simply submit a list of links without webmaster outreach, you are likely going to be disappointed.
Watch the first 2 minutes of the video a few times. Matt clearly says "...when you have contacted each webmaster multiple times....and there are only a small fraction of links left....that is when you can use the tool."
-
Nice summary at SEWatch:
http://searchenginewatch.com/article/2217602/Google-Disavow-Links-Tool-Now-Available
I'm curious about the "Most sites shouldn’t use this tool,” Cutts said. “Use caution." caveat. I've basically got only one client out of many that I'd even need to consider using this for. But I can't help but imagine hyper paranoid SEOs trying to massage their link profile down to the last drop of relevance. My gut feel is that this is a 'last resort' tool, and not a 'everyday SEO' tool.
-
Based on what Matt said, it sounds like Google only wants you to use the tool for links that you've tried to remove manually but couldn't. My guess is they may ignore your disavowals if you rely too much on the tool.
-
The links are in the YouTube video description.
"Access the feature here:
https://www.google.com/webmasters/tools/disavow-links-main" -
Cutt's did not indicate how to download the tool. Did I miss that?
-
Thanks for the heads up. Just watched the video.
-
Really looking forward to this tool... But Joeys question is Really important. Does anyone have suggestions?
-
Awesome tool. How can I tell which links to my site I should disavow? We get a bunch of random links per day that look spammy, but how can I tell for sure that removing them will help rather than hurt?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Drastic surge of link spam in Webmaster Tools' Link Profile
Hello all I am trying to get some insights/advice on a recent as well as drastic increase in link spam within my Webmaster Tools' Link Profile. Before I get into more detail, I would like to point out, that I did find some relevant MOZ community posts addressing this type of issue. However, my link spam situation may have to be approached from a different angle, as it concerns two sites at the same time and somewhat in the same way. Basically, starting in July 2017, from one day to the other, a multitude of domains (50+) is generating link spam (at least 200 links a month and counting) and to cut a long story short, I believe the sites are hacked. This is because most of the domain names sound legit and load the homepage, but all the sub-pages linking to my site contain "adult" gibberish. In addition, it is interesting to see, that each sub-page follows the same pattern, scraping content from my homepage including the on-page links - that generate the spammy backlinks to my sites - while inserting the adult gibberish in between (basically it's all just text and looks like as if a bot is at work). Therefore, it's not like my link is being inserted "specifically" into pages or to spam me with the same anchor text over and over. So, I am not sure what kind of link spam this really is (or the purpose of it). Some more background information: As mentioned above, this link spam (attack?) is affecting two of my sites and it started off pretty much simultaneously (in addition, the sites focus on a competitive niche). The interesting detail is, that one site suffered a manual penalty years ago, which has been lifted (a disavowal file exists and no further link building campaigns have been undertaken after the cleanup), while the other site has never seen any link building efforts - it is clean, yet the same type of spam is flooding that websites' link profile too. In the webmaster forums the overall opinion is, that Google ignores web spam. All well. However, I am still concerned, that the dozens of spammy links pointing to the website "with a history" may pose a risk (more spam on a daily basis on both sites though). At the same time I wonder, why the other "clean" site is facing the same issue. The clean sites' rankings do not appear to be impacted, while the other website has seen some drops, but I am still observing the situation. Therefore, should I be concerned for both sites or even start an endless disavowal campaign on the site with a history? PS: This MOZ article appears to advice so: https://moz.com/blog/do-we-still-need-to-disavow-penguin "In most cases, sites that have a history of collecting unnatural links tend to continue to collect them. If this is the case for you, then it’s best to disavow those on a regular basis (either monthly or quarterly) so that you can avoid getting another manual action." What is your opinion? Sorry for the long post and many thanks in advance for any help/insight.
White Hat / Black Hat SEO | | Hermski0 -
Google Algorithm non-manual penalty. How do we fix this (quality?) drop?
Hi, See attached image. We received a non-manual penalty on March 22, 2015. I don't think we ever came out of it. We have moved up due to the Penguin update, but we should (by DA PA) be up on the first page for tons of stuff and most keyword are lower than their true strength. What kind of quality errors could be causing this? I assume it was a quality update. I am working on the errors, but don't see anything that would be so severe as to be penalized. What errors/quality problems am I looking for? We have tons of unique content. Good backlinks. Good design. Good user experience except for some products. Again, what am I looking for? Thanks. non-manual-penalty.png
White Hat / Black Hat SEO | | BobGW0 -
Google's Related Searches - Optimizing Possible?
Does anyone know how Google determines what suggestions show up at the bottom of SERPs? I've been working with a client to boost his local ranking, but every time we do a branded search for his business his competitors keep popping up in the "Searches related to ______" section.
White Hat / Black Hat SEO | | mtwelves0 -
Google admits it can take up to a year to refresh/recover your site after it is revoked from Penguin!
I found myself in an impossible situation where I was getting information from various people that seem to be "know it all's" but everything in my heart was telling me they were wrong when it came to the issues my site was having. I have been on a few Google Webmaster Hangouts and found many answers to questions I thought had caused my Penguin Penalty. After taking much of the advice, I submitted my Reconsideration Request for the 9th time (might have been more) and finally got the "revoke" I was waiting for on the 28th of MAY. What was frustrating was on May 22nd there was a Penguin refresh. This as far as I knew was what was needed to get your site back up in the organic SERPS. My Disavow had been submitted in February and only had a handful of links missing between this time and the time we received the revoke. We patiently waited for the next penguin refresh with the surety that we were heading in the right direction by John Mueller from Google (btw.. John is a great guy and really tries to help where he can). The next update came on October 4th and our rankings actually got worse! I spoke with John and he was a little surprised but did not go into any detail. At this point you have to start to wonder WHAT exactly is wrong with the website. Is this where I should rank? Is there a much deeper Panda issue. We were on the verge of removing almost all content from the site or even changing domains despite the fact that it was our brand name. I then created a tool that checked the dates of every last cached date of each link we had in our disavow file. The thought process was that Google had not re-crawled all the links and so they were not factored into the last refresh. This proved to be incorrect,all the links had been re-cached August and September. Nothing earlier than that,which would indicate a problem that they had not been cached in time. i spoke to many so called experts who all said the issue was that we had very few good links left,content issues etc.. Blah Blah Blah, heard it all before and been in this game since the late 90's, the site could not rank this badly unless there was an actual penalty as spam site ranked above us for most of our keywords. So just as we were about to demolish the site I asked John Mueller one more time if he could take a look at the site, this time he actually took the time to investigate,which was very kind of him. he came back to me in a Google Hangout in late December, what he said to me was both disturbing and a relief at the same time. the site STILL had a penguin penalty despite the disavow file being submitted in February over 10 months ago! And the revoke in May. I wrote this to give everyone here that has an authoritative site or just an old one, hope that not all is lots just yet if you are still waiting to recover in Google. My site is 10 years old and is one of the leaders in its industry. Sites that are only a few years old and have had unnatural link building penalties have recovered much faster in this industry which I find ridiculous as most of the time the older authoritative sites are the big trustworthy brands. This explains why Google SERPS have been so poor for the last year. The big sites take much longer to recover from penalties letting the smaller lest trustworthy sites prevail. I hope to see my site recover in the next Penguin refresh with the comfort of knowing that my site currently is still being held back by the Google Penguin Penalty refresh situation. Please feel free to comment below on anything you think is relevant.
White Hat / Black Hat SEO | | gazzerman10 -
Google says 404s don't cause ranking drops, but what about a lot of them
Hello, According to Google here, 404s don't cause rankings to go down. Our rankings are going down and we have about 50 or so 404s (though some may have been deindexed by now). We have about 300 main products and 9000 pages in general on this Ecommerce site. There's no link equity gained by 301 redirecting the 404s. A custom 404 page has been made linking to the home page. There's nothing linking to the pages that are 404s Provided that no more 404s are created, can I just ignore them and find the real reason our rankings are going down?
White Hat / Black Hat SEO | | BobGW0 -
Has google done well with these search results?
I am struggling to grasp the new logic behind google, my understanding was that they wanted to return more related searches so that the search matched the results giving people exactly what they are looking for from trusted suppliers. However I work in the vacation rental niche and I have found that the individual long tail searches have started to become less valuable as they are no longer giving the exact property. Here is a screenshot of the top 10 results for the key phrase "10 bedroom villas in quinta do lago" Position 1 & 2 are good results and would be expected however the next 7 positions are completely not related to the search, yes it is quinta do lago. But I am looking specifically for a 10 bedroom villa, none of these pages offer 10 bedroom villas. I actually found my listing outside the top 20 and mine is a 10 bedroom villa in quinta do lago. Does anyone have anything that can enlighten me on this? Thanks Andy 0bqdRJi
White Hat / Black Hat SEO | | iprosoftware0 -
How google treats RSS fetcher?
All I want to know how google treats RSS fetcher. I want to push my blogs to my own website. Both are there on the same domain . But I want them to be updated automatically on the home page of my website through RSS fetcher if i create it on my blog page. My site name is http://www.myrealdata.com and my blog site name is http://www.myrealdata.com/blog
White Hat / Black Hat SEO | | SangeetaC0 -
Why Proved Spammers are on 1st Google SERP's Results
This question is related exclusively to few proved spammers who have gained 1st Google search results for specific terms in the Greek market, targeting Greek audience. Why he looks spammer and very suspicious? For instance, the site epipla-sofa.gr, sofa.gr, fasthosting.gr and greekinternetmarketing.com look suspicious regarding their building link activities: 1. suspicious spiky link growth 2. several links from unrelated content (unrelated blog posts forom other markets, paid links, hidden links) 3. excessive amount of suspicious link placements (forum profiles, blog posts, footer and sidebar links) 4. Greek anchor text with the keyword within articles written in foreign languages (total spam) 5. Unnatural anchor text distribution (too many repetitions) So the main question is: Why Google is unable to recognize/trace some of these (or even all) obvious spamming tactics and still these spammy sites as shwon below reside on the 1st Google.gr SERPs. Examples of spam sites according to their link building history: www.greekinternetmarketing.com www.epipla-sofa.gr www.fasthosting.gr www.sofa.gr All their links look very similar. They use probably software to build links, or even hack authority sites and leave hidden links (really dont know how they could do that). Could you please explain or share similar issues? Have you ever found any similar cases in your industry, and how did you tackle it? We would appreciate your immediate attention to this matter. Regards, George
White Hat / Black Hat SEO | | Clickwisegr0