Finding broken links / resources by topic
-
Hi fellow mozzers!
In an effort to ensure we're exploring every avenue when launching our new website, I was hoping to find some useful broken links / resources that we could incorporate into our link building.
We have used the standard tools for this (W3C, Xenu etc), but they all seem to have the same issue in that they reveal all the missing links on a site (although some don't actually tell you the page they are on), but you still have to sort them to see if the links/ resource is related to your theme.
When you're on a niche site, this obviously isn't an issue, but on a site like Mashable (to use the example given in a recent SEOmoz blog) it could result in wading through hundreds of links to find one relevant one right at the end.
Is there a tool that allows you to specify what theme links you are looking for from a site, or better yet one that allows you to check multiple sites for multiple missing themed links in one go?
Or is the best way to export the list and just search the document for certain keywords?
-
What about searching for articles about care homes on BBC then seeing if any of those have missing links on an article-by-article basis? If you're lucky, they may also have a tag or a section that fits closely enough with your topic that you can find a listing of all of the articles that are withing that tag/category and just review those.
-
Hi Chris,
Thanks for your response. I have used both Xenu and Screaming Frog before, and they are great for searching a whole site within your niche where every broken link / missing resource is an opportunity. This is probably an easier thing to explain using an example:
We do work for a chain of care homes. If I go to, say www.carehomes.co.uk and check for missing links, I know that all the results will be an opportunity to make contact and build a relationship with a webmaster in the care home niche. So there's no need to filter these, but rather just to work my way through the list trying to build as many valuable new contacts as possible.
But if I run a missing links search on the BBC, it may bring back hundreds or thousands of results, but only one or two will be related to the care homes industry and therefore present an opportunity to reach out. So that's the aspect I'm enquiring about - going to a site that covers a range of topics and quickly finding opportunities within that relate to my niche.
-
I recommend that Chrome is part of your link building tool kit and get a broken link checker, you'll also find that visiting web pages with images off in Chrome will speed up your prospecting efforts. I can see you want to search a whole website for a broken link then try a tool like Screaming Frog or Xenu.
-
Hi Jon,
Thanks for getting involved - having read your great blog, it's cool to get your take. Love the idea about then building relationships with all the others who link to that missing URL.
But my question remains the same - while I understand that there's more to it than the initial link, and there are greater opportunities when it comes to relationship building as well as link building, I am keen to get a handle on the best way to find missing resources, broken links etc within a certain niche; so I know how to use search modifiers to look up various sites, resources etc within our niche, I'm less clear on how to go to larger sites (BBC, wikis, Mashable etc) that cover many topics and find out whether opportunities are available within my niche.
Also, is there a Firefox friendly tool that's similar to DHP?
Thanks for any extra help you can give!
-
+1 for Chris!
Sorry I just got to this question, but Nick, as Chris said, there's much more value than the initial link you get. Granted that some opportunities are really only worthwhile for that specific link, most opportunities for broken links should be turned into something far greater - a relationship.
Also, when you find URLs of broken resources, go to Open Site Explorer and plug those URLs in. Find other people linking to that same broken resource, and reach out to them as well. Ideally you should start an excel spreadsheet of different pages linking to broken resources, so as you come across more broken links, you can add even more prospects. In the end, you should never run out of sites to do some BLB on.
Hope this helps Nick!
-
Hi Chris,
Thanks for your reply. I had stumbled across that site earlier and found it to be very useful. And yes, I agree that the tactic is a great way to outreach and relationship build as well as a simple like for like - although the issue of quickly finding such sites within a certain niche still applies.
It seems that Domain Hunter Plus gets some of the way there, but I'm running Firefox rather than Chrome, so any alternatives would be cool.
-
Hi Nick,
Broken Link building isn't just about getting a broken link replaced with your link. It's also a tactic to build a relationship with a blogger/webmaster to later pitch them a proposal for a link.
Jon Cooper (@pointblankseo) loves this technique so be sure to hop over to his blog
http://pointblankseo.com/creative-broken-link-building
He also recommends a few broken link tools too
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is Link equity / Link Juice lost to a blocked URL in the same way that it is lost to nofollow link
Hi If there is a link on a page that goes to a URL that is blocked in robots txt - is the link juice lost in the same way as when you add nofollow to a link on a page. Any help would be most appreciated.
Intermediate & Advanced SEO | | Andrew-SEO0 -
SITEMAP - Does <changefreq>and <image:title>have any apreciable effect?</image:title></changefreq>
Hi everyone. It was hard to find some actual evidence that some of the atributes to be declared in a sitemap have some real impact.
Intermediate & Advanced SEO | | Gaston Riera
Particularly, im interested in these two: <changefreq></changefreq> and**image:title</image:title>** I've used them in a few cases just to check their effect and couldnt see any.
Do you have any experience with these? Or any other atribute that might be helpful, in order to create a more accurate and effective sitemap? Also, this could be a great topic to create a new Moz Blog post, the one about sitemap is 8years old.0 -
Should I remove all vendor links (link farm concerns)?
I have a web site that has been around for a long time. The industry we serve includes many, many small vendors and - back in the day - we decided to allow those vendors to submit their details, including a link to their own web site, for inclusion on our pages. These vendor listings were presented in location (state) pages as well as more granular pages within our industry (we called them "topics). I don't think it's important any more but 100% of the vendors listed were submitted by the vendors themselves, rather than us "hunting down" links for inclusion or automating this in any way. Some of the vendors (I'd guess maybe 10-15%) link back to us but many of these sites are mom-and-pop sites and would have extremely low authority. Today the list of vendors is in the thousands (US only). But the database is old and not maintained in any meaningful way. We have many broken links and I believe, rightly or wrongly, we are considered a link farm by the search engines. The pages on which these vendors are listed use dynamic URLs of the form: \vendors<state>-<topic>. The combination of states and topics means we have hundreds of these pages and they thus form a significant percentage of our pages. And they are garbage 🙂 So, not good.</topic></state> We understand that this model is broken. Our plan is to simply remove these pages (with the list of vendors) from our site. That's a simple fix but I want to be sure we're not doing anything wring here, from an SEO perspective. Is this as simple as that - just removing these page? How much effort should I put into redirecting (301) these removed URLs? For example, I could spend effort making sure that \vendors\California- <topic>(and for all states) goes to a general "topic" page (which still has relevance, but won't have any vendors listed)</topic> I know there is no distinct answer to this, but what expectation should I have about the impact of removing these pages? Would the removal of a large percentage of garbage pages (leaving much better content) be expected to be a major factor in SEO? Anyway, before I go down this path I thought I'd check here in case I miss something. Thoughts?
Intermediate & Advanced SEO | | MarkWill0 -
If linking to contextual sites is beneficial for SE rankings, what impact does the re=“nofollow” attribute have when applied to these outbound contextual links?
Communities, opinion-formers, even Google representatives, seem to offer a consensus that linking to quality, relevant sites is good practice and therefore beneficial for SEO. Does this still apply when the outbound links are "nofollow"? Is there any good research on this out there?
Intermediate & Advanced SEO | | danielpressley0 -
Link Building with a Scholarship
One of my clients is using a scholarship to build links. We have a nofollow PR campaign getting ready to start and are doing some social marketing for the scholarship page on the site. We are also trying to get backlinks from highschools and colleges that link to scholarship opportunities. So far this has been a slow process. Does anybody have any advice for speeding any of this up? Has somebody ever done a campaign like this before? Is there some kind of database with financial aid contact info for a lot of schools? I contact a lot of schools and always tend to get put on the backburner.
Intermediate & Advanced SEO | | Atomicx0 -
Outbound link to PDF vs outbound link to page
If you're trying to create a site which is an information hub, obviously linking out to authoritative sites is a good idea. However, does linking to a PDF have the same effect? e.g Linking to Google's SEO starter guide PDF, as opposed to linking to a google article on SEO. Thanks!
Intermediate & Advanced SEO | | underscorelive0 -
Max # of Products / Links per Page on E-Commerce Site
We are getting ready to re-launch our e-commerce site and are trying to decide how many products to list per category page. Some of of our category pages have upwards of 100 products. While I'd love to list ALL the products on the root category page (to reduce hassle for customer, to index more products on a higher PR page), I'm a little worried about having it be too long, and containing too many on-page links. Would love some guidance on: Maximum number of internal links on a page If Google frowns on really long category pages Anything else I should be considering when making this decision Thanks for your input!
Intermediate & Advanced SEO | | AndrewY2 -
Should we block urls like this - domainname/shop/leather-chairs.html?brand=244&cat=16&dir=ascℴ=price&price=1 within the robots.txt?
I've recently added a campaign within the SEOmoz interface and received an alarming number of errors ~9,000 on our eCommerce website. This site was built in Magento, and we are using search friendly url's however most of our errors were duplicate content / titles due to url's like: domainname/shop/leather-chairs.html?brand=244&cat=16&dir=asc&order=price&price=1 and domainname/shop/leather-chairs.html?brand=244&cat=16&dir=asc&order=price&price=4. Is this hurting us in the search engines? Is rogerbot too good? What can we do to cut off bots after the ".html?" ? Any help would be much appreciated 🙂
Intermediate & Advanced SEO | | MonsterWeb280