Can't say with 100% confidence, but sounds like it might work. You could always upload it to a server and use a robots.txt checker to validate, although sometimes the validator tools may incorporate slight differences in edge cases like this that make them moot.

It seems that the URL you asked me to run at OSE's home page should not be the back-link but the my site's link whose back-links I want? Is that correct?

Yes, that's correct.

It could be that you are seeing only links pointed to the URL. Be sure to use the filters and drop-down to choose "pages on this root domain"  (see the attached screenshot)

Otherwise feel free to shot me the URL and I'll be happy to take a look.

One note: different indexes always list different URLs, even Google Webmaster Tools doesn't list a complete set of links to your site. Moz's index could be considered "medium" size. It doesn't contain every link to your site, but it contains the majority of the important ones.

9pkVWtu.png

Mmm... Try running a URL first and then try the reports tab on the far right. Let more know if it works.

It's likely that if you are getting a "0" that indicates no data available.

Mozscape will only report the status code for pages it has actually crawled in the last index. If it hasn't crawled the page recently, it doesn't report the status code. (it still has link metrics for that URL because it can see and calculate all the incoming links to that page without crawling it)

If these are backlinks to a particular site, you should be able to get the same data using Open Site Explorer, and running a custom report to export the large amount of data.

Another option, if you actually want to crawl all of those links and return a status code is Screaming Frog. 

The Frog has both a paid and free version, but it's one of the most useful paid tools I have ever used.Hope this helps! Cheers.

Hi Gregory,

Great suggestion. It might be a little challenging to mix the private crawl (Your campaign) with the public one (OSE) but it's certainly possible to cross-pollinate data.

In the meantime, we're working on better incorporating our "just discovered links" in OSE to be included in the main index. This means that anytime a link is tweeted (our source of discovery for Just Discovered Links) it will be included for crawling in the general index.

Regardless, thanks for your input into this matter, and I apologize for it being a frustrating experience.

Cheers,

Cyrus

The one thing I would add to your list of criteria, if you choose to go that route, is to look at Google Analytics landing pages and make sure the individual profiles don't any inbound search traffic.