Wow nice one mate did not know that in the Top Pages tab that is perfect! I'll remember to click around more often now.

I found this tool on my adventures which was exactly what I was after: http://www.tomanthony.co.uk/tools/bulk-http-header-compare/

Also cheers for your walkthrough, having problems with the site still bleeding 404 pages, first thing first however is fixing these pages getting high quality links to them

Cheers again!

Cheers Andy & Kyle

Problem with this tool as it works similar to Xenu which is great for making sure your current navigation isn't causing problems.

My problem is there are over 15k links pointing to all sorts of articles and I have no idea what's live and what's not.  Running the site through that tool won't report the pages that aren't linked in the navigation anymore but are still being linked to.

Example is manually checking some of the links I've found that the site has quite a few links from the BBC going to 404 pages.  Running the site through Xenu or Screamy Frog doesn't find these pages.

Ideally I'm after a tool I can slap in a load of URLs and it'll do a simple HTTP header check on them.  Only tools I can find do 1 or 10 at a time which would take quite a while trying to do 15k!

Hi all,

I'm currently looking after a collection of old newspaper sites that have had various developments during their time. The problem is there are so many 404 pages all over the place and the sites are bleeding link juice everywhere so I'm looking for a tool where I can check a lot of URLs at once.

For example from an OSE report I have done a random sampling of the target URLs and some of them 404 (eek!) but there are too many to check manually to know which ones are still live and which ones have 404'd or are redirecting. Is there a tool anyone uses for this or a way one of the SEOMoz tools can do this?

Also I've asked a few people personally how to check this and they've suggested Xenu, Xenu won't work as it only checks current site navigation.

Thanks in advance!