How can I find all broken links pointing to my site?
-
I help manage a large website with over 20M backlinks and I want to find all of the broken ones. What would be the most efficient way to go about this besides exporting and checking each backlink's reponse code?
Thank you in advance!
-
To find all broken links pointing to your site, you can use various online tools such as Google Search Console, Ahrefs, or SEMrush. These tools allow you to analyze your website's backlink profile and identify any links that lead to pages returning 404 errors or other status codes indicating broken or inaccessible content. Additionally, you can manually check for broken links by reviewing your website's referral traffic, monitoring social media mentions, and conducting periodic audits of your site's content and backlinks.
-
To find all broken links pointing to your site, you can use online tools like Google Search Console's "Links to Your Site" report, which lists external pages linking to your site. Additionally, you can utilize website crawling tools such as Screaming Frog or Ahrefs' Site Explorer to identify broken links from external sources. Regularly monitoring and fixing broken links helps maintain website health, improves user experience, and enhances SEO performance.
-
You can find broken links pointing to your website by using website crawl tools like Screaming Frog or Ahrefs, checking crawl errors in Google Search Console, and monitoring your backlinks with tools like Ahrefs or SEMrush. Regularly checking your referral traffic and using online broken link checkers can also help you identify broken links.
-
You can find broken links pointing to your website by using website crawl tools like Screaming Frog or Ahrefs, checking crawl errors in Google Search Console, and monitoring your backlinks with tools like Ahrefs or SEMrush. Regularly checking your referral traffic and using online broken link checkers can also help you identify broken links.
-
We often use Moz Pro, its a fantastic SEO tool, we also use Screaming Frog as well, we use this to find any broken internal links.
this has helped improve our on-page seo, for our garden office company.
-
Ha, I feel silly. I do use ahrefs, but somehow the broken backlinks tool escaped me. This is perfect, thank you!
-
Hi Steven,
I assume many of these backlinks will be broken because pages were removed from your site without being properly redirected. If that is the case, Open Site Explorer's Link Opportunities (Link Reclamation) tool should be a big help. This will show all 404 URLs with inbound links that you can recapture be 301 redirecting. Additionally, you can look up the backlinks to each of these 404 pages and reach out to each webmaster requesting they update the URL of their link.
I've also had success exporting Top Pages reports (Moz or Majestic are my preferred tools for this), running any URL with a backlink to it through Screaming Frog and pulling 404 pages/broken links (or even 302 redirects) that way. I usually find additional opportunities that do not show up in the Link Reclamation report.
Hope this helps!
-
Use ahrefs and split the crawls for the main folders of the website. Actually, consider the priorities because then you don't have to do all of the 20m. Start with the main ones and go step by step for being able to crawl the majority.
-
I agree with Kevin. Ahref has that capability assuming you don't run into size constraints. Here's a quick post that explains where to find it. (See https://ahrefs.com/blog/turning-broken-links-site-powerful-links-ahrefs-broken-link-checker/.)
-
Have you looked into ahrefs? I know a ton of horsepower behind it, but don't know if it can handle checking 20m. Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Any idea why Google Search Console stopped showing "Internal Links" and "Links to your site"
Our default eCommerce property (https://www.pure-elegance.com) used to show several dozen External Links and several thousand Internal Links on Google Search Console. As of this Friday both those links are showing "No Data Available". I checked other related properties (https://pure-elegance.com, http:pure-elegance.com and http://www.pure-elegance.com) and all of them are showing the same. Our other statistics (like Search Analytics etc.) remain unchanged. Any idea what might have caused this and how to resolve this?
Intermediate & Advanced SEO | | SudipG0 -
Is it bad for SEO to have a page that is not linked to anywhere on your site?
Hi, We had a content manager request to delete a page from our site. Looking at the traffic to the page, I noticed there were a lot of inbound links from credible sites. Rather than deleting the page, we simply removed it from the navigation, so that a user could still access the page by clicking on a link to it from an external site. Questions: Is it bad for SEO to have a page that is not directly accessible from your site? If no: do we keep this page in our Sitemap, or remove it? If yes: what is a better strategy to ensure the inbound links aren't considered "broken links" and also to minimize any negative impact to our SEO? Should we delete the page and 301 redirect users to the parent page for the page we had previously hidden?
Intermediate & Advanced SEO | | jnew9290 -
What other SEO strategies and tactics can be accomplished at this point?
The client specializes in home, commercial and restoration cleaning services and offers carpet, upholstery, area rug, wood floor, drapery, tile and gout, stone and restoration services such as (water damage, fire damage, mold remediation). This company has over 40 franchises. Carpet cleaning service is their core service that gets them to the customer’s door, then technicians get to up sell on the secondary services (tile, upholstery, stone, wood…) One of the main strategies we have implemented successfully is to be more visible at the local level was a local SEO strategy with every locations having their own unique landing pages for each of the services they would offer ( for instance the san diego location would a customized page for carpet, upholstery and all services they would offer). We have done a great job optimizing each of these locations. Optimization includes on page optimization, unique NAP information, local citations (manual insertions + Yext). We also added local markups and for some of the franchises we added review snippet. Link building around carpet cleaning has been conducted as well through guest posting and in links content. Most of our locations have a google business updated and optimized as well. We are working to get as many reviews as possible but it is still very challenging. In summary basic SEO tactics have been implemented following google’s guideline. Traffic & rankings got us a positive progressive boost in mid 2013(April to August) but in april 2014 the site got hit by manual penalty affecting all carpet cleaning queries only. I was able to cleanup the mess within 2 months luckily but unfortunately we still saw a drop of %40 in traffic (vs 2013) on average in all carpet cleaning pages YoY (april to august). 2015 Q1 traffic has improved by 6% compared to Q1 2014 which is good but still not at the level we were. With the pigeon update and all the high authoritative directories (yelp, angieslist) taking over more and more of the organic real estate in the SERP and increase in competition we have had a hard time getting back to where we were (2013) and we may never get back unless another algorithmic change happens. Another frustrating thing is local competition which has the worst sites as far as UX and content and still outranks us ( such as http://www.carpetcleaninglosangeles.com/). My main goal is to figure out a plan to increase traffic within the carpet cleaning pages and therefore increase conversions. Like it or not rankings for carpet cleaning queries is affecting our CC traffic, so working towards improving them is one way to go even though I shouldn’t focus all my efforts on just rankings. 2015 SEO main activities has been:
Intermediate & Advanced SEO | | Ideas-Money-Art
-local link building= somewhat successful (Seeing some rankings improvements but not consistent across all franchises)
-content marketing projects= quiet successful as far as traffic, branding and link acquisition but not seeing enough ROI
-new web design (launched late 2014)
-google business reviews
-local citations duplicate removal
-weekly blogging ( successful as far as traffic and branding) Things I would like to work on:
-improve Bounce rate within site
-improve CTR by adding review snippets across all franchises
-add industry certification logos to build trust with users and improve conversion
-add before and after pictures of services performed
-site speed (has slowed down compared to the old site) I would love get feedback on what other crucial components(that I am missing) can be done to improve most of these franchises rankings. I am a bit out of ideas as far as what else can be done. Thanks!0 -
On site links triggering anchor text algorithmic penatly?
I'm trying to figure out why a drop in ranking occurred and think it may be related to an increase in on site links. I've attached images of the SEO moz report showing a jump in links from a few hundred to around 15,000 within the space of a week. I think this may be due to some on site work I did when I created categories (I use wordpress) for a large number of cities and towns in the UK. I soon realised I'd run into duplicate content issues and removed all these categories within a few days. As I added categories I also ran into 'too many on page links' warnings as each category I added created a new link and I ended up with hundreds on each page. If you look at the analytics reports I suffered a huge drop in rankings on the 10th March and think this could be due to an on site anchor text problem that was caused by adding the categories and in turn creating many on site links. SEO moz found these links on the 11th and 25th Feb but my guess is that Google found them around at the same time but if these links are the problem then why didn't my rankings drop until the 10th March? Surely they would have dropped sooner? Would this cause a drop in rankings? I've recieved an email from google saying that no manual penalty was applied to the site after I submitted a reconsideration request. Therefore it must be some kind of algorithmic penalty. Could this be the problem and if not what else should I look at. My baclink profile appears to be okay and I've been careful to vary my anchor text with inbound link building. I'm at a loss as to what to do next. Any help will be much appreciated! UXsMLYS.png Ov9AOs8.png
Intermediate & Advanced SEO | | SamCUK0 -
SEO Link on Clients Site
Hey SEOMozzers, Quick question. In light of the possible 'over-optimisation' penalties pending from Google should we be looking to remove the SEO links to our site from our Clients websites? I appreciate that including a link to our site from an anchor text that includes 'SEO' in it may be like waving a flag to Search Engines saying we are carrying out SEO on our Clients sites. Obviously we would sooner risk a drop in our SEO keyword rankings than risk a penalty of any kind for our Clients. What is the recommended practice here?
Intermediate & Advanced SEO | | MiroAsh0 -
Nobody Can Answer This? What Can Google Tell About Videos?
I uploaded a video to youtube one time and then went to upload it again, but saved differently with different tags. Youtube rejected the second upload as being the same as the first. Really, it was the same... just a different file with different tags. Now, I was thinking about making and uploading some similar but not identical videos for embedding on some web pages. Was thinking I'd make the voice overs different, but the images mostly the same montage. Do you think Youtube/Google will see it as the same video? I kind of assume that it didn't fly when I first tried it some time ago because youtube was looking at the audio in the way it can make a transcription. Do you think if the audi,o, file name, tags were different, it wouldn't matter if the video was the same? Thanks!
Intermediate & Advanced SEO | | 945010 -
Will Linking To "Offical Sites" Increase My SEO?
I own a movie trailer website. (Where you can watch movie trailers) Will having links on each page that are for "offical website" of each movie, increase my SEO?
Intermediate & Advanced SEO | | rhysmaster0 -
How 'Off Topic' can I go - site wide?
Hello, I am currently number 1 for a competitive keyword - so don't want to push the wrong button and self destruct! My site is highly focused on one relatively narrow niche with about 50-60 pages of content bang on topic. I was wondering if Google will discredit my site in any way if I start adding pages that are** 'loosely related' **to the overall theme of my niche. Some of them are what you might call sister concepts with maybe one mention of my target keyword in the body..... Does the algo value what percentage of the whole site's content is on/ off topic? If so how important is this as a factor? Thanks a lot
Intermediate & Advanced SEO | | philipjterry0