Open Site Explorer - Finding 404s from my competitor's external linking Root Domains
-
I want to find websites that have linked 404s to my competitors. My goal is to contact webmasters who have linked to my competitors with 404s, but I cannot figure out how to get Open Site Explorer to give me that data.
I can easily see this in GWT for my own site, but I need this for my competition instead.
Does anybody know a quick way to get this information?
-
You could also look to Blekko or now Bing for some of that link data, in addition to SEOmoz, and run it through a status checker like Eppie described.
-
Depending on how large the OSE list is, you can run it through a free bulk status checker like this one: http://www.seoautomatic.com/unique-tools/bulk-url-checker/
That will return the status codes of the urls you drop in but it only accepts 50 rows per batch. You could easily create a similar tool using a scraper that would accommodate more URLs per run -- using PHP you'd just have to use the curl function to pull in the pages being linked to, then use curl_getinfo($curl_handle,CURLINFO_HTTP_CODE); to grab the response code. If it's a 404, you write that entry to an export file.
Hope that helps!
Eppie
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I just uncovered a massive 500+ domain PBN linking to competitors
As the title, some competitors I've been watching are using a PBN they (or their agency) have built. I'm looking to get some discussion on how you approach situations like this - do you just report all of the domains to Google and pray they do something? There are 4 sites I'm looking at, all competing in the same niche with very similar websites (different branding and content, but essentially the same pages). I thought all were related, but after Excel-ing all the domains to see which overlap I've found that there's several sets; PBN 1 covers 117 domains that link to competitors A, B & C. Signaling to me that these are owned by the same person. PBN 2 links together B & C with 30 domains, PBN 3 is just C with 40 domains. PBN 4 is just B with 105 domains. PBN 5 is just A with 10 domains. PBN 6 is D by itself with more than 340 domains. Signaling to me that this one probably isn't owned by the same person. It looks like new domains are added to these PBNs every week and this has been going on for quite some time. Now, I'm fully against use of PBNs that don't use authentic websites that provide value, and I can't find any of these sites that aren't just a basic WP template with a single-word text logo followed by spun content. This is a goldmine, because according to Ahrefs these sites are pulling in well over 500,000 monthly visitors between them, and these links make up the majority of each site's link profile. If these networks were to crumble, that would open up a big opportunity for more authentic sites to rank well. How would you recommend to tackle this? Do I find example URLs and write reports for each of the 500+ domains or are there better ways of working through this?
Link Building | | Leads.Bz0 -
Accidentally generated navigation links that point to American site from Australian site.
Somehow we ended up getting hundreds-of-thousands of links coming from our .au (Australia site) to our .com (America site). We believe that something happened during a change that turned a handful of our example.com.au navigational and footer links into back links pointing to example.com and sub-domains of the American version. We are currently fixing this, but we are wondering if this could potentially be problematic in terms of a penguin penalty due to an unnatural linking campaign or back link scheme. Could this error create major problems for us in the near future if we have corrected the issue? Your thoughts are welcome! Thanks!
Link Building | | tdawson090 -
Best way to get a Linking Root Domains
Hello, What is the best way to get a Linking Root Domains to my websites? Fore example: www.i-phony.com
Link Building | | iphony0 -
Document download sites linking to my site. Should I disavow?
I downloaded my links through the Google Webmaster site and I have a number of new links that appear to be coming from document download sites. They have basically taken my PDFs and have them to where they can be downloaded. They are also linking back to my site and creating what I feel are sketchy links. I don't actually want traffic coming to these PDFs. They are basically sample articles for my writing company and it's just a portfolio. Here's one of the links: http://www.give-me-doc.com/Trailer-Brake-Types.pdf So, what or can I do about them? Should I disavow them? Any suggestions would be appreciated. Thanks,
Link Building | | wordsyouwant
Valerie0 -
Links between own sites cause bad pagerank?
Many people say PR does not matter, but for me its an indicator that links from a domain with higher PR may rank better. My client has a about 4 different travel-sites of very different kinds of travelling. His sites are not ranking bad but all sites have just a PR 0-2 although the content is unique. I made the experience that even sites with few content will have at least a PR of 3 after some years with no SEO effort. One reason is may some part of duplicate content (4 Tours begin in Manaus, so the description for Manaus is on all the 4 Tour pages the same) but another is that the pages have few external links but many of other sites he is owning... like: also check out this -> link to another own site. Question: If I take all these links away (they even don't cause many referrals at all) - will this have a positive effect on rankings? Means trying to have always more external links from not self owned sites is a good start? Thanks for sharing your experiences Holger
Link Building | | inlinear0 -
Are link exchanges bad for SEO these days? Also, is adding my site to free yet relevent directory sites a bad idea?
I operate a computer services company in Eugene, Oregon called "Eugene Computer Geeks". We do a lot of web design, and need incoming links to my site very badly. Lately I've been asking clients if they would link to me, but they almost always ask for a link in return. If we exchange links, does Google penalize my site? Would the incoming link be better for SEO if I'm not linking back to the other site? ALSO Is it possible that manually submitting my site to free, yet relevant web directories would hurt my rankings? It's not a big deal to me if it doesn't help my rankings, as I see a benefit to having my site listed, but wanted to make sure there wasn't a chance that it would hurt my rankings. As far as I know all the directories are free from SPAM, porn, warez, or anything like that. Thanks!
Link Building | | eugenecomputergeeks0 -
Linking to root domain or specific sub-site
Hello, When optimizing for multiple keywords, should I try to get links back to the root domain of the company I work with, or would it be better to link back to sub-sites specific to the keyword I am optimizing for? Does 'getting the root up' help all keywords I work with? Cheers, Mike
Link Building | | Malarowski0 -
New ways to get links (excluding on site link bait)?
Fellow SEOs, I’m looking for a new way to reach out to bloggers and site owners for links. There are quite a few link bait techniques to lure bloggers thanks to = amazing content, infographics,...but there are not so many articles on ways to contact bloggers/webmasters and ask for links... We all know that contacting site owners directly and politely asking then to place a link on their home page is as useful as a comb in Bruce willis’s hand. Link exchange is as dead as the Dodo and business partner links are usefull and easier to get but opportunities are often limited. I have been organizing contests for bloggers recently and it has been quite successful up to now, but I always like to have a spare trick up my sleeve. So if any of you have a decent method to reach out to bloggers/webmaster and get decent links please let me know, I will be forever thankful ; ) Cheers
Link Building | | ref.price0