Best way to filter out the nofollowed links from WMT?
-
When I'm downloading links from WMT to audit them for my unnatural links clients I generally check each individual link. If it is a nofollowed link I make a note that it is nofollowed and move on. I'm thinking that there has to be a quicker way to find all of the nofollowed links so that I can filter them out from the beginning. How would I do that?
-
Yes, that's right. What you'd end up with is a small list of URLs that have nofollow anywhere/somewhere on the page. If it's a big list of 5000 links and this tool can trim it down to maybe 200 having nofollow somewhere or 500 or 2000. In either case, it's a small list. Definitely not a solution to what you are looking for.
-
Hmmm...interesting. I was just playing with screaming frog and thought I had it because you can upload a list of links and then when you export them there is a column for "nofollow", but that column means that the page is nofollowed. That means that a nofollowed link from a meta robots follow,index page would not be flagged.
I see what you're saying about searching for nofollow on the page, but I can't see it being specific enough. A lot of pages may have for example nofollowed comment links but my link in the article could still be followed.
-
Marie
What you could do is use Screaming Frog to crawl all the links (the combined list of ahref links and WMT and then use the custom filter to check if the domain is there, ie your link is there and then the 2nd filter to check if there is the word nofollow anywhere on the page. It's not going to be a perfect list, because you may end up seeing a page that is linking to you, but is nofollow'ing somebody else from the same page.
But then most of the times, the regular links, they are either nofollowed or they are not. "Mostly".
I hope this helps.
-
agreed and good point. (That is why we end up with soooo much SAS).
Thanks -
Thanks Robert. Yes, I usually do use ahrefs and the links from there are nicely marked as nofollowed and easy to filter out. I generally combine the links from ahrefs with the links from WMT and remove the duplicates.
I find that often there are links that are only on one list and not both. For small sites that's not a big deal, but for a large site there may be thousands of nofollowed links that only exist on the WMT list. I figured that if I could find a way to filter out the nofollowed links from the WMT list as well then this would save me a lot of time.
-
Marie,
Have you used ahrefs.com before?
If not I think it will be very useful to you given that I know what you do. I took a small site we handle and looked at what I have in WMT and then ran it on ahrefs. On WMT we are showing 68 distinct external links. On ahrefs we are showing 62. Worst case about a ten percent difference. (For finding those 6, download both csv files and sort and should be quick. Obviously with thousands you have more work.)
With ahrefs, you can simply sort them by nofollow, mark your GWMT data, then boom. You are real close to magic.If you want to see it, etc. I have a conference call with a bunch of Cannucks at 0930 CDT for about 45 min. After we can talk if you call me. Oh, sorry, forgot you were up North...
Hope it helps,
Robert
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do many nofollow links from one website will hurt my website SEO?
Do many nofollow links from one website will hurt my website SEO? Please let me know. I am getting about 20 thousand UGC links from a news website after I posted one comment on an article. Please suggest asap.
Link Building | | mikeeb_50150 -
Best Way to Market a White Paper
Hello everyone, I had to write a white paper for an entirely different purpose than to drive links, but it did come out very well and I think it would be a fantastic tool in my SEO efforts. What do you guys think is the best way to market a white paper? Obviously I will let our email subscribers know about it and place a link to it in a prominent place on the website, but if anyone has any extra ideas, I would love to hear them. Also, what is the best way to host it? Taking the Moz beginners guide for example, I would love to just put it on my server like http://static.seomoz.org/files/SEOmoz-The-Beginners-Guide-To-SEO-2012.pdf but is it necessary that I make it web-friendly like http://moz.com/beginners-guide-to-seo? Can the former do anything for SEO? What if there are links to and from the site? Any advice would be great. Thanks
Link Building | | CleanEdisonInc0 -
New website, small business, niche market --- what's my best link building strategy?
Hi everyone, We are a small company manufacturing a niche product (indoor playground equipment), our new English website (www.funlandiaplaygrounds.com) has just been launched 2 months ago, before that we didn't even have a website in English. As the international sales manager of such a small company, I have to do all the international marketing jobs including SEO, but before this I'm almost a noob on SEO. I've just started the linking building work for our website, after a research on the links of our highest ranked competitors, I have found out that almost ALL of the external links of them come from directories and purchased links, many links are very dubious, please see the open explorer results below: http://www.opensiteexplorer.org/links?page=1&site=www.spiplay.co.uk&sort=page_authority&filter=&source=&target=page&group=1 http://www.opensiteexplorer.org/links?site=www.softplay.com%2F http://www.opensiteexplorer.org/links.html?page=1&site=www.china-cheer.com&sort=page_authority&filter=&source=&target=page&group=1 http://www.opensiteexplorer.org/links?site=http%3A%2F%2Fwww.aileplay.com%2F http://www.opensiteexplorer.org/links?site=internationalplayco.com%2F The search keywords is: indoor playground equipment. According to the latest SEO theory and numerous posts I've read here, links from these directories carry very low value, and solely relying on these links may even cause penalty to the website, but the reality is, all these competitors rank on the top as a result of these "spammy" links. For example this website www.aileplay.com that has the highest PA of 64 and rank on the first page on the search result of indoor playground equipment, has tons of spammy links. That is the situation we are facing now, then my questions is: As a small business in such a niche market, what is our best strategy to rank well in a reasonable time, say 3 months to 6 months? I do not think our competitors are very strong and hard to beat, I believe we will beat them in content creation for sure, but what should we do in link building? should we start to get directory links now, as it obviously works for them? Or should we first create more attractive content, then use these content to get natural links BEFORE we submit for directory, as recommended by most link experts here? If so should we just sit back doing nothing before the link worthy content is created and natural links starts to come in? I highly appreciate any comments! DSG_clan
Link Building | | DSG_clan0 -
JavaScript is crawled by search engines, isn’t it? Does it mean that links embedded in JavaScript pass link juice?
I wonder If links embedded in JavaScript from an external Website pass link juice to the linked page and thus have a positive effect on google rankings. I read that JavaScipt is craweld. Does it mean that also the link juice is passed? I'm looking forward to your answers.
Link Building | | Tabea0 -
Link building
i want to ask a question. i am sure this is kind black hat seo. look at this web site http://www.199999dollars.com/ if we also create website like this and put a banner as domain for sale and in the footer put back links to our domain ? thanks
Link Building | | idreams0 -
Link Farming
Are link farms still bad? I still am not sure about this question. I know that some people still do link farms. If they are bad, wouldn't a directory be considered a link farm? For instance I can get my site on a .EDU, but it will just be a list of links. Is that bad?
Link Building | | blackrino0 -
.edu links
Hi mozzers, I've had some great success reaching out to many .edu webmasters. Often they are professors and such. My question is, i'm guessing during the summer holiday period, reaching out to these webmasters won't be so fruitful. I'm not in the US and was wondering when the US Summer holidays are for universities over there? Also, does anyone have experience outreaching to these webmasters over the holidays? Peter
Link Building | | PeterM221 -
A good link builder / link building agency for Spanish content
Hi, I am looking for a good link building agency or freelance to execute a link building strategy for the next months. The content is in Spanish. Could anyone recommend me a good agency or a good link builder for Spanish content? Thank you very much! Jorge
Link Building | | jorgediaz0