Google launches their Disallow Tool
-
-
Hi Irving,
Today i have Compiled a comprehensive backlink report for one of my hotel client (http://www.fairfieldinnhotelcedarrapids.com/).I have identified all bad links and create one .txt file and upload via google disallow tool. now my question is, How do i know that all dead links has been removed? Is there any way to know status?
Thanks
-
If you Disavowed "good" links to your site, your rankings may be lowered as a result.
If you Disavowed "bad" links, then your Penguin issue could be reduced or resolved.
The best course of action is to allow a trained SEO professional examine each linking domain to determine if the links violate Google's Guidelines and only Disavow the links which do violate those guidelines. Also, the Disavow tool should not be used until after every possible action has been taken to remove the link. Google is quite clear on this topic. If you use the Disavow tool without "significantly" reducing the manipulative links to your site, it likely will not help.
-
I admit it... I panicked and disavowed a ton of domains that I didn't recognize as good links and I went from mid-page-2 to lower-page-3. So...my question is: what happens if I submit a new disavow file that has only a fraction of the links. Or, better yet, what if I delete the disavow file altogether with a file that has a comment saying Oops, sorry, we didn't know what we were doing with this tool and respectfully request to undo our mess".
A very good SEO told me to not chase after my disavow list, and I get what he's saying, but it's hard to not remember the days pre-disavow when I was at least on page 2 ... I was on page 1 for 14 years since 1998 until penguin hit! (I sell bean bag chairs and am speaking of serps for "bean bag chairs").
www.ahhprods.com in case anyone is curious
Thanks!
-
So far my webmaster response is about 10%, so you have no idea how much this tool can relieve some pain after so many attempts.
To the best of my knowledge, the Disavow Tool will have absolutely no impact on your success rate. It seems designed to help ensure webmasters who have a manual penalty lifted are not affected by Penguin.
-
This is gonna be interesting how everything works out.
I've sent a reconsideration request a day or two prior to the release. I will see how that request goes and then update the spreadsheet with new links I've removed as well as using disavow.
So far my webmaster response is about 10%, so you have no idea how much this tool can relieve some pain after so many attempts.
-
The damage was done before i came on the picture and there is no stats from before. the site rangs below other sites owned by the same clent with much weaker linking profiles. As i mentioend the site has the best of links, this is why i am prepared to get rid of any links that look even the slightest doggy. The site should rank number 1 when you look at the competition
I just dont have the time or budget to try to ask for removal, a attemp was made long ago with no sucess.
-
Very busy with a new project out of Arizona.
i have been following Mitt closely. He might just get over the line.
-
-
Thanks... Should have read the YouTube description.
-
This says to me that your site was spared an across the board penalty, but your rankings for specific keywords that have been overused in your anchor text have been suppressed. I would look at your incoming link anchor texts and see which one(s) you are no longer ranking for.
-
Excellent sir.
We will know pretty soon how everything shakes out once people start reporting back, but my suggestion would be that if you have a site that is not penalized you should NOT use this tool as an effort to try and clean up any spammy back links and clean up your good-to-bad backlink ratio. The reason is, this is a tool to be used as a last effort in trying to come back from a penalty when there are some links you tried to remove but simply cannot.
Sending this report will put eyeballs on your site and bring unnecessary attention to your site. Why ask Google to review your backlink profile and look at the nastiest links pointing to your site if your site is currently healthy.
An exception to this rule I think would be if you notice you are clearly under a negative SEO attack. Then it would make sense to be proactive.
-
Very solid analysis Ryan, good stuff.
-
Long time comming and quiite a messy interface. why they could not do somthing like Bing did with there tool is a mystery.
I have a client with a unatural link warning, saying "for this specific incident we are taking very targeted action on the unnatural links instead of your site as a whole"
to me this sounds like these links have been discounted anyhow and that the site is not punished, and maybe no need to do anything, but then goes on to say "If you are able to remove any of the links, please submit a reconsideration request, including the actions that you took."
so that makes me think i do need to do something. not very clear.
This client has a lot of very good links from CNN, NYT and a host of others, but partisipated in a link wheel. The blogs in this link wheel are real blogs rather than your obvious mass made for links blogs and makes it hard to identify what are what. i am thinking to disavow anything thats could be doggy, he has such good links I think it better to have a few false positives rather then leave any bad links in the profile.
Back to my first point, i was hoping for a click and job done approch link in BWMT.
-
Nice write-up Ryan, thanks.
Looks like an aggressive tool, I can see a lot of Webmasters running into trouble with this one.
If you contact a blog to get a link removed and then realise after actually I have made a mistake, or you login to a directory and remove it yourself and realise after you have made a mistake you can work on getting it back.
I get the feeling if you don't go through the process Ryan put down and you make a mistake with the Disallow Tool you wont be able to get those links back.
-
You are so right Ryan! This tool is not a shortcut at all. I fear that a lot of webmasters who have an unnatural links warning are going to jump straight to the disavow tool and ignore the actual reconsideration request process. As Matt says in the video, you still need to make a thorough attempt at trying to get the links removed on your own in order to have a manual penalty revoked.
-
Thanks for opening this discussion Irving. I have had calls from clients today regarding this "change" and it seems many site owners are simply caught up in the idea without realizing the true impact of this change. Resolving a manual Google penalty for manipulative links involves 4 steps prior to the release of this tool:
1. Compile a comprehensive backlink report. Many sites which suffer from a manipulative link penalty are absolutely doomed to have their Reconsideration Requests declined before they are even submitted. Why? Because they have not captured all the links to their site. You cannot rely on any single tool or even 2 tool combination. For each client I work with we compile a list of every known backlink to their site. How? By combining Google + Bing + OSE + Majestic + AHREFs data. Each data source offers links the others do not seem to find.
2. Properly identify all the manipulative links to the target site. Once again, many site owners repeatedly fail their Reconsideration Request and have no real chance at success because they try to take the easy way out. Attempting to replace real effort with fake work is what caused the penalty in the first place.
a. A thorough understanding of the difference between an organic link and manipulative link is required. In short, you must calibrate your understanding of links to match Google. How do you view free directory links? The reality is 99%+ of them are manipulative. How about press releases? Do you think most press releases are organic links? When site owners pay another company to publish articles they wrote with links back to their site, does that sound natural to you?
b. How about broken links? Can you use an automatic link checker and then if the link is not on the URL simply cross it off the list? In a significant percent of cases the link has simply moved to another page on the linking site. Some sites have very dynamic link structures where one day a URL is at ?page=20 and the next it is at ?page=21. Other sites make URL changes over time. You must search each site using their search widget and a Google site: search before assuming the site's link is gone.
c. Is the link marked NoFollow? You need to keep searching the page to ensure there are not other followed links on the same page.
The above are just some examples of gaps in the process of many who attempt to resolve this type of penalty. The disavow tool's introduction does not impact this step.
3. Webmaster Outreach. Once you have a comprehensive list of all known links to your site and have properly identified all the manipulative links, there is a need to contact every site on the list. Another common issue is those attempting to resolving a manipulative link issue give up far too easy. Site owners can be contacted via their WHOIS email address, the email address on their site AND the contact form on their site. You can call them, send a letter and chase them down on social networks. This type of sincere effort can lead to 50%+ reduction in links to your site.
Once sincere and comprehensive efforts have been made to remove the links, Google can clearly tell because there will be a "significant" reduction in manipulative links. At that point, THEN the Disavow tool can be used.
4. Filing a thoroughly documented Reconsideration Request. Three days later, the Reconsideration Request can be submitted.
So the introduction of this tool actually did not reduce any step in the process at all. Matt clearly outlined Google's expectation the tool is only used after a webmaster outreach campaign has been completed. If you expect to be able to simply submit a list of links without webmaster outreach, you are likely going to be disappointed.
Watch the first 2 minutes of the video a few times. Matt clearly says "...when you have contacted each webmaster multiple times....and there are only a small fraction of links left....that is when you can use the tool."
-
Nice summary at SEWatch:
http://searchenginewatch.com/article/2217602/Google-Disavow-Links-Tool-Now-Available
I'm curious about the "Most sites shouldn’t use this tool,” Cutts said. “Use caution." caveat. I've basically got only one client out of many that I'd even need to consider using this for. But I can't help but imagine hyper paranoid SEOs trying to massage their link profile down to the last drop of relevance. My gut feel is that this is a 'last resort' tool, and not a 'everyday SEO' tool.
-
Based on what Matt said, it sounds like Google only wants you to use the tool for links that you've tried to remove manually but couldn't. My guess is they may ignore your disavowals if you rely too much on the tool.
-
The links are in the YouTube video description.
"Access the feature here:
https://www.google.com/webmasters/tools/disavow-links-main" -
Cutt's did not indicate how to download the tool. Did I miss that?
-
Thanks for the heads up. Just watched the video.
-
Really looking forward to this tool... But Joeys question is Really important. Does anyone have suggestions?
-
Awesome tool. How can I tell which links to my site I should disavow? We get a bunch of random links per day that look spammy, but how can I tell for sure that removing them will help rather than hurt?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How much does doing google search queries dilute your search console data
So, does performing dozens or hundreds of search queries a day dilute your search console data, or does google filter this out or how does this work exactly? When you do an icognito search and click on your site does this information get recorded in search console?
White Hat / Black Hat SEO | | jfishe19880 -
Does Google and Other Search Engine crawl meta tags if we call it using react .js ?
We have a site which is having only one url and all other pages are its components. not different pages. Whichever pages we click it will open show that with react .js . Meta title and meta description also will change accordingly. Will it be good or bad for SEO for using this "react .js" ? Website: http://www.mantistechnologies.com/
White Hat / Black Hat SEO | | RobinJA0 -
Submitting a page to Google Search Console or Bing Webmaster Tools with nofollow tags
Hello, I was hoping someone could help me understand if there is any point to submit a domain or subdomain to Google Search Console (Webmaster Tools) and Bing Webmaster Tools if the pages (on the subdomain for example) all have nofollow/noindex tags ... or the pages are being blocked by the robots.txt file). There are some pages on a data feed onto a subdomain which I manage that have these above characteristics ... which I cannot change ... but I am wondering if it is better to simply exclude from submitting those from GWT and BWT (above) thereby eliminating generating errors or warnings ... or is it better to tell Google and Bing about them anyway then perhaps there is a chance those nofollow pages may be indexed/contextualised in some way, making it worth the effort? Many thanks!
White Hat / Black Hat SEO | | uworlds
Mark0 -
How does Google handle product detail page links hiden in a <noscript>tag?</noscript>
Hello, During my research of our website I uncovered that our visible links to our product detail pages (PDP) from grid/list view category-nav/search pages are <nofollowed>and being sent through a click tracking redirect with the (PDP) appended as a URL query string. But included with each PDP link is a <noscript>tag containing the actual PDP link. When I confronted our 3rd party e-commerce category-nav/search provider about this approach here is the response I recieved:</p> <p style="padding-left: 30px;">The purpose of these links is to firstly allow us to reliably log the click and then secondly redirect the visitor to the target PDP.<br /> In addition to the visible links there is also an "invisible link" inside the no script tag. The noscript tag prevents showing of the a tag by normal browsers but is found and executed by bots during crawling of the page.<br /> Here a link to a blog post where an SEO proved this year that the noscript tag is not ignored by bots: <a href="http://www.theseotailor.com.au/blog/hiding-keywords-noscript-seo-experiment/" target="_blank">http://www.theseotailor.com.au/blog/hiding-keywords-noscript-seo-experiment/<br /> </a> <br /> So the visible links are not obfuscating the PDP URL they have it encoded as it otherwise cannot be passed along as a URL query string. The plain PDP URL is part of the noscript tag ensuring discover-ability of PDPs by bots.</p> <p>Does anyone have anything in addition to this one blog post, to substantiate the claim that hiding our links in a <noscript> tag are in fact within the SEO Best Practice standards set by Google, Bing, etc...? </p> <p>Do you think that this method skirts the fine line of grey hat tactics? Will google/bing eventually penalize us for this?</p> <p>Does anyone have a better suggestion on how our 3rd party provider could track those clicks without using a URL redirect & hiding the actual PDP link?</p> <p>All insights are welcome...Thanks!</p> <p>Jordan K.</p></noscript></nofollowed>
White Hat / Black Hat SEO | | eImprovement-SEO0 -
Google admits it can take up to a year to refresh/recover your site after it is revoked from Penguin!
I found myself in an impossible situation where I was getting information from various people that seem to be "know it all's" but everything in my heart was telling me they were wrong when it came to the issues my site was having. I have been on a few Google Webmaster Hangouts and found many answers to questions I thought had caused my Penguin Penalty. After taking much of the advice, I submitted my Reconsideration Request for the 9th time (might have been more) and finally got the "revoke" I was waiting for on the 28th of MAY. What was frustrating was on May 22nd there was a Penguin refresh. This as far as I knew was what was needed to get your site back up in the organic SERPS. My Disavow had been submitted in February and only had a handful of links missing between this time and the time we received the revoke. We patiently waited for the next penguin refresh with the surety that we were heading in the right direction by John Mueller from Google (btw.. John is a great guy and really tries to help where he can). The next update came on October 4th and our rankings actually got worse! I spoke with John and he was a little surprised but did not go into any detail. At this point you have to start to wonder WHAT exactly is wrong with the website. Is this where I should rank? Is there a much deeper Panda issue. We were on the verge of removing almost all content from the site or even changing domains despite the fact that it was our brand name. I then created a tool that checked the dates of every last cached date of each link we had in our disavow file. The thought process was that Google had not re-crawled all the links and so they were not factored into the last refresh. This proved to be incorrect,all the links had been re-cached August and September. Nothing earlier than that,which would indicate a problem that they had not been cached in time. i spoke to many so called experts who all said the issue was that we had very few good links left,content issues etc.. Blah Blah Blah, heard it all before and been in this game since the late 90's, the site could not rank this badly unless there was an actual penalty as spam site ranked above us for most of our keywords. So just as we were about to demolish the site I asked John Mueller one more time if he could take a look at the site, this time he actually took the time to investigate,which was very kind of him. he came back to me in a Google Hangout in late December, what he said to me was both disturbing and a relief at the same time. the site STILL had a penguin penalty despite the disavow file being submitted in February over 10 months ago! And the revoke in May. I wrote this to give everyone here that has an authoritative site or just an old one, hope that not all is lots just yet if you are still waiting to recover in Google. My site is 10 years old and is one of the leaders in its industry. Sites that are only a few years old and have had unnatural link building penalties have recovered much faster in this industry which I find ridiculous as most of the time the older authoritative sites are the big trustworthy brands. This explains why Google SERPS have been so poor for the last year. The big sites take much longer to recover from penalties letting the smaller lest trustworthy sites prevail. I hope to see my site recover in the next Penguin refresh with the comfort of knowing that my site currently is still being held back by the Google Penguin Penalty refresh situation. Please feel free to comment below on anything you think is relevant.
White Hat / Black Hat SEO | | gazzerman10 -
Where can i see ejemple of disavow files to adapt mine in order to send to google
Can i send a disavow file to google as CSV file. Where can i see ejemple of disavow files to adapt mine in order to send to google
White Hat / Black Hat SEO | | maestrosonrisas0 -
New sub-domain launches thousands of local pages - is it hurting the main domain?
Would greatly appreciate some opinions on this scenario. Domain cruising along for years, top 1-3 rankings for nearly all top non-branded terms and a stronghold for branded searches. Sitelinks prominently shown with branded searches and always ranked #1 for most variations of brand name. Then, sub-domain launches that was over 80,000 local pages - these pages are 90-95% similar with only city and/or state changing to make them appear like unique local pages. Not an uncommon technique but worrisome in a post Panda/Penguin world. These pages are surprisingly NOT captured as duplicate content by the SEOMoz crawler in my campaigns. Additionally about that same time a very aggressive, almost entirely branded paid search campaign was launched that took 20% of the clicks previously going to the main domain in organic to ppc. My concern is this, shortly after this launch of over 80k "local" pages on the sub-domain and the cannibalization of organic clicks through ppc we saw the consistency of sitelinks 6 packs drop to 3 sitelinks if showing at all, including some sub-domains in sitelinks (including the newly launched one) that had never been there before. There's not a clear answer here I'm sure but what are the experts thoughts on this - did a massive launch of highly duplicate pages coupled with a significant decrease in organic CTR for branded terms harm the authority of the main domain (which is only a few dozen pages) causing less sitelinks and less strength as a domain or is all this a coincidence? Or caused by something else we aren't seeing? Thanks for thoughts!
White Hat / Black Hat SEO | | VMLYRDiscoverability0 -
I've done some link building on my website... why is google showing this?
Hi guys, it seems Google is going crazy as always, basically sometimes i'm ranked first page sometimes i'm not there, not sure if it's because of my link building and Google is indexing the links. At the moment in IE i'm top 3-4 for this keyword however the Title tag is not what I set it to be it's basically taking the product name then adding something after it. (I know google sometimes changes to what they want if they feel its more relevant but it isn't in this case) Not sure if this is normal for my keyword to keep appearing then dissapearing in Google. I noticed in FF my keyword isn't there but in IE it is. I've logged out of my Google account deleted all history/cookies etc. Even checked on my friends computer. Hope this makes sense and i'm not going crazy!
White Hat / Black Hat SEO | | InkCartridgesFast0