Best way to filter out the nofollowed links from WMT?
-
When I'm downloading links from WMT to audit them for my unnatural links clients I generally check each individual link. If it is a nofollowed link I make a note that it is nofollowed and move on. I'm thinking that there has to be a quicker way to find all of the nofollowed links so that I can filter them out from the beginning. How would I do that?
-
Yes, that's right. What you'd end up with is a small list of URLs that have nofollow anywhere/somewhere on the page. If it's a big list of 5000 links and this tool can trim it down to maybe 200 having nofollow somewhere or 500 or 2000. In either case, it's a small list. Definitely not a solution to what you are looking for.
-
Hmmm...interesting. I was just playing with screaming frog and thought I had it because you can upload a list of links and then when you export them there is a column for "nofollow", but that column means that the page is nofollowed. That means that a nofollowed link from a meta robots follow,index page would not be flagged.
I see what you're saying about searching for nofollow on the page, but I can't see it being specific enough. A lot of pages may have for example nofollowed comment links but my link in the article could still be followed.
-
Marie
What you could do is use Screaming Frog to crawl all the links (the combined list of ahref links and WMT and then use the custom filter to check if the domain is there, ie your link is there and then the 2nd filter to check if there is the word nofollow anywhere on the page. It's not going to be a perfect list, because you may end up seeing a page that is linking to you, but is nofollow'ing somebody else from the same page.
But then most of the times, the regular links, they are either nofollowed or they are not. "Mostly".
I hope this helps.
-
agreed and good point. (That is why we end up with soooo much SAS).
Thanks -
Thanks Robert. Yes, I usually do use ahrefs and the links from there are nicely marked as nofollowed and easy to filter out. I generally combine the links from ahrefs with the links from WMT and remove the duplicates.
I find that often there are links that are only on one list and not both. For small sites that's not a big deal, but for a large site there may be thousands of nofollowed links that only exist on the WMT list. I figured that if I could find a way to filter out the nofollowed links from the WMT list as well then this would save me a lot of time.
-
Marie,
Have you used ahrefs.com before?
If not I think it will be very useful to you given that I know what you do. I took a small site we handle and looked at what I have in WMT and then ran it on ahrefs. On WMT we are showing 68 distinct external links. On ahrefs we are showing 62. Worst case about a ten percent difference. (For finding those 6, download both csv files and sort and should be quick. Obviously with thousands you have more work.)
With ahrefs, you can simply sort them by nofollow, mark your GWMT data, then boom. You are real close to magic.If you want to see it, etc. I have a conference call with a bunch of Cannucks at 0930 CDT for about 45 min. After we can talk if you call me. Oh, sorry, forgot you were up North...
Hope it helps,
Robert
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ran a backlink competitor analysis and found that the competitor has their links coming from various linkedin and youtube posts but my client does the same thing and im not seeing any links coming from those sources for them?
Ran a backlink competitor analysis and found that the competitor has their links coming from various linkedin and youtube posts but my client does the same thing and im not seeing any links coming from those sources for them?
Link Building | | Stongex0 -
What is the number of links do you require your link builder to attain each week or month? What is a reasonable goal?
Hello Mozzers... I would like to get a survey or feedback from other Mozzers who owns an SEO company or manages / hire link builders. **What is the average number of links does your link builder need to attain per week or month? what is their goal? ** I understand quality over quantity but I want to make sure there is a reasonable average to provide them goals and something to achieve on. Of course reward them more if they exceed or get .edu links. What do you institute? What do you think is fair and achievable per website? PS. There is no right or wrong answers here. I am looking for a measurable answer not subjectable. Again just gathering MEASURABLE GOALS.
Link Building | | ChatterBuzzMedia0 -
How much time does it take for the links to be forwarded to redirected link?
Hi there,
Link Building | | MoeezLodhi
Thank you for taking out some time for this question; I have changed the permalinks last week for a website.. I forgot to redirect old permalinks to the new one.. So I did 301 redirection, it has been 4-5 days since I did that but the links are not forwarded to the new Permalink so far.
How much time should I wait for the links to be forwarded to the new permalinks? Secondly, I am sure I have done the 301 redirect correctly, as when I go to the old url / permalink it directs me to the new permalink. So I am sure 301 is done correctly. Do I need to submit the sitemap again?0 -
Do links from between common sites you run count as "bad" links?
Hi everyone,
Link Building | | AMA-DataSet
Iv recently been asked to review a group of sites. There are 3 sites, each of these sites has a link to the other two sites within the footer or the navigation.
These site are about a similar topic each provides a different perceptive or aims at a specific section of the industry so its not like the links are to irreverent sites. However because the links are in a global section they are repeated thousands of times on each site and count for a large proportion of the link profile to each site, I don't think this is good practise and I want to remove them or at least add a no-follow but my client insists they are relevant to each other and doesn't not want the links removing. What would be best in this situation? remove them? no-follow them? or leave them? Thank you in advance,
Liam0 -
What is the best way to go about building backlinks?
I'm a newbie here and my head is spinning because I don't know where or how to start the backlink building process. My website is 1 month old and I don't have any backlinks yet. what is the best way to go about it? Should I study my competition's backlinks and go from there? I'm so confused I need help! Please help! Any information will be greatly appreciated!!
Link Building | | allie741 -
Best way to set up a support site - sub domain, separate site or com/support?
My company is setting up our support site. It has been suggested that we set it up as a separate domain - www.company-support.com, rather than setting it up as a sub-domain (www.support.company.com) or the usual www.company.com/support. The person who proposed this believes it wlll create link juice, but i wonder if splitting the traffic will create more harm than good? Opinions please!
Link Building | | googilvie0 -
Following Penguin, what is the best practice for a web design agency placing a footer link in client sites?
For years we have included a 'Web Design by ...' link in the footer of all client websites designed by us. However, following the Penguin update, it seems that this legitimate practice could now be penalised. Should we be removing those links from our client's sites? There are tens of thousands, all with similar or identical text! For future client sites, should we avoid these footer links altogether? Or maybe limit the link to a single page on each site?
Link Building | | LewisJenkins691 -
For a new site, does it matter which sites I get back links from first? I.e., are the first back links more important than later ones?
I've heard that when a site is new, the sources from which it gets its first back links are very important -- that the early links are more important for ranking than later links. Is this true. If so, what would be some good places to get these very first links? Thanks.
Link Building | | sigma3x0