Dead links-urls
-
What is the quickest way to get Google to clean up dead
link? I have 74,000 dead links reported back, i have added a robot txt to
disallow and added on Google list remove from my webmaster tool 4 months ago.
The same dead links also show on the open site explores.Thanks
-
thank you 410 was what i needed.
-
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
I had 3 inexperience developers, who did not how to write
the urls so they created many different versions. It is hard work out which is
the right version. I also have someone like BT after leavening there service 2
years ago they still seem to index my old links even though my domain is not
with them. They are all for 404 pages. -
Can you offer clarification as to what you view as a "dead link"?
If you mean a link to a page on your site which no longer exists, then your options are as follows:
-
take John's advice and 301 the link to the most relevant page on your site
-
allow the link to 404. 404 errors are a natural part of the internet. You should be sure to have the most helpful 404 page possible. Include your site's normal navigation, a search box, most popular articles, etc.
Blocking pages in robots.txt is usually a bad idea and is more likely to add to the problem rather then fix it. If you do not block the page in robots.txt, Google would then crawl the page, see the error and remove it from their index. Because you block the page they can no longer view the page so they will likely leave it in for longer.
Google normally promptly removes web pages submitted with the URL Removal Tool. The tool is designed to remove pages which can damage your site or others. For example, if confidential information was accidentally published. It is not designed to be used to remove 74k pages because you decided to remove them from your website.
If these dead links are simply pages you removed from your site, I advise you to remove the robots.txt block and then decide to 301 them or allow them to 404. Google should then clean up the links within 30-60 days.
If you want to speed up the process as much as possible, there is one other step you can take. Set a 410 (Gone) code for the pages. When Google receives a 404 response, they are unsure if the page is simply temporarily unavailable so they keep it in the index. If they receive a 410 response, you are telling Google the page is GONE and they can update their index faster.
-
-
Are the links 404 pages or just expired content?
-
The links are index, i need them really cleaned up, not a
redirect, and users/customers find it frustrating -
You could try setting up a 301 redirect in htaccess.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Link Tracking List Error
"I have been maintaining 5 directories of backlinks in the 'Link Tracking List' section for several months. However, I am unable to locate any of these links at this time. Additionally, the link from my MOZ profile is currently broken and redirects to an error page, no to Elche Se Mueve. Given the premium pricing of MOZ's services, these persistent errors are unacceptable."
Moz Pro | | Alberto D.0 -
Where is the link prospecting tool?
I feel like last year when Moz was still SEOMoz I used a beta tool that would help you build a bunch of queries for link prospecting. You would tell it what your sites about and a few other pieces of information, and it would give you a list of google queries to get you started (ie inurl:directory <industryname> +"add site"</industryname>). However, I'm having a hard time finding this tool, or any reference to it on the web. It's also possible that it wasn't a moz tool but I'm misremembering where I found it. Does anybody have any idea what I'm talking about?
Moz Pro | | brettgus1 -
5XX (Server Error) on all urls
Hi I created a couple of new campaigns a few days back and waited for the initial crawl to be completed. I have just checked and both are reporting 5XX (Server Error) on all the pages it tried to look at (one site I have 110 of these and the other it only crawled the homepage). This is very odd, I have checked both sites on my local pc, alternative pc and via my windows vps browser which is located in the US (I am in UK) and it all works fine. Any idea what could be the cause of this failure to crawl? I have pasted a few examples from the report | 500 : TimeoutError http://everythingforthegirl.co.uk/index.php/accessories.html 500 1 0 500 : Error http://everythingforthegirl.co.uk/index.php/accessories/bags.html 500 1 0 500 : Error http://everythingforthegirl.co.uk/index.php/accessories/gloves.html 500 1 0 500 : Error http://everythingforthegirl.co.uk/index.php/accessories/purses.html 500 1 0 500 : TimeoutError http://everythingforthegirl.co.uk/index.php/accessories/sunglasses.html | 500 | 1 | 0 | Am extra puzzled why the messages say time out. The server dedicated is 8 core with 32 gb of ram, the pages ping for me in about 1.2 seconds. What is the rogerbot crawler timeout? Many thanks Carl
Moz Pro | | GrumpyCarl0 -
SEOmoz Not Picking Up Links
I'm finding that SEOmoz often doesn't pick up on many of the links my client's websites are attaining. The links do appear in search engine and often have a high domain authority (often PR links, which I why I follow up to see if they've been picked up). I do tend to see many of the links appear in webmaster tools, so it's a little frustrating that they don't appear, even after months of pages being live. Thoughts?
Moz Pro | | SebastianDyer0 -
Domain Authoriy/Link Authority - Link Building
At what point do you think that an inbound link becomes a bad or low quality link when it comes to the inbound links page domain Authority and page Authority. SO as they are scored 1-100 in each case. At what score would you attempt to get rid of such links.
Moz Pro | | askshopper0 -
Competitive Link Comparison vs. Open Site Explorer
I get different external followed links showing in the Competitive Link Comparison vs. Open Site Explorer. The total number of links is different as well. I thought this was the same info - just one tracks ongoing and one is just a "one-off" tool. Is this not the case? Do the count links differently? Thanks! Kevin
Moz Pro | | yandl0 -
How long before new links show up in OSE?
Hi - How long should it be before a brand new external link to our site shows up in OSE?
Moz Pro | | tcolling0 -
Link Acquisition Assistant
Hi Can anyone explain what all the info within the link acquisition tool is all about? I put in to look for Money Hoodies, Money being the brand name and Hoodies being the product type. This is what I get back, what do the links mean when I click them? I don't get it? money hoodies + "submit site"
Moz Pro | | WillBlackburn
money hoodies + "submit url"
money hoodies + "intitle:directory"
money hoodies + "intitle:resources"
money hoodies + "directory list"
money hoodies + "inurl:list"
money hoodies + "intitle:list"
money hoodies + "inurl:directory"
money hoodies + "inurl:resources"
money hoodies + "add url"
money hoodies + "submit url"
money hoodies + "suggest url"
money hoodies + "suggest a url"
money hoodies + "submit site"
money hoodies + "submit a site"
money hoodies + "submit your site"
money hoodies + "add a url"
money hoodies + "add a site"
money hoodies + "add listing"
money hoodies + "add your listing"
money hoodies + "submit a listing"
money hoodies + "submit listing"
money hoodies + "submit your website"0