Any tool to get all the old or archived links of a website?
-
Hi all,
We can see the old pages/links of a website using web.archive.org. But we need to manually check all the cached versions to know those. Is there anyway to get all those links/pages?
Thanks
-
This first method is a complete guess if it just went down you might have a chance of grabbing the rest on google of it by typing in sight:thedomain.tld in google I don’t know how old this thing is so it’s a possibility.
Try http://archive.is Or time-travel.mementoweb.org
http://archive.is/20130504233657/http://moz.com/
You can find just links or html useing
http://www.internetfrog.com/mywebsite/archive/ with archive.org
Try when in The way back machine take the code and use Regex to grab the URLs
Use this inside of archive.org.
https://regex101.com/library/V36Bah
https://regex101.com/r/V36Bah/1
https://regex101.com/r/fbX1LZ/1
http://network.ubotstudio.com/forum/index.php/topic/12459-regex-explained-match-extract-urls/
https://mathiasbynens.be/demo/url-regex
Use google search inur:thedomain.tld any variation that you think will get your URLs
you never know what you might find.
The site Get data from any link tools like Majestic, Ahrefs, Moz OSE that will give you a outline of site structure if it was Crawl and I had a lot of back links you can get a lot of URLs that way.
One thing you have to do with the way back machine or archive.org. This simply use whatever page they have and click on that look for the site special by going to the homepage and trying to save that . So you can grab the URLs out of the navigation outside of that and doing Google searches for anything depending on how old it is it may still be there I don’t know how long ago this occur? But Google is not going to be a bad place to look. After that going to Webmaster to look for a xml site map or anything you could have useed To crawl the website prior to it coming down. If you know ran a crawl via Moz, screamingfrog or Deep Crawl you’re in luck. call the hosting if you own the domain
Are you the new owner? If you are there might be a small chance the hosting company or the old owner had a back up of the entire site never know but you need to ask.
I wish you all the very best
sorry about the formatting I’m on my cell phone
tom
-
I can't think of a better alternative then the one you're already using. It depends a bit on your use case, if it's just about links you might be able to get some historical data from Majestic but that's probably not matching your intent.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword Rank Tracking tools
Hi Does anybody know if there are tools to track keywords ranking back for the last 6 months? Our existing software was malfunctioning, and we lost all kws ranking data for the last 6 months(( Thank you
Other SEO Tools | | AlexBiertones0 -
Looking for tools to benchmark an industry
Hi everyone - I'm trying to benchmark an entire industry. Given that Google seems to adjust what ranking signals should be counted more heavily based on the industry/query - I'd like to be able to benchmark a specific industry. As a silly example - let's say I want to know what ranking signals would most effect coffee shops, real estate agents, or manufacturers. Has anyone here ever found an efficient way to analyze: 1. Who the top 10 are for 5-10 keywords, in that industry 2. What they have in common (e.g. meta info, content length, ssl certs, etc.) 3. What were the differences in the higher ranking ones (domain name registration age, content quality, etc.) It seems like there has to be a way to do this given that Moz, SEM Rush, and others release yearly reports that detail which ranking signals seem to be most important. I'd just like to be able to know what the top ranking signals are for a specific industry, based off of who is ranking really well in that industry already. Thanks!
Other SEO Tools | | growthat0 -
Free proofreading tool
Does anyone use any free / open source profreading tool that not only corrects spelling, double-spacing and capital letters, but also meaning. Let's say it will tell you verb or subject is missing in the sentence. Or that a sentence doesn't make sense, such as 'Dog English he does looks well twelve'. Thanks. Katarina
Other SEO Tools | | Katarina-Borovska0 -
Any tool to check complete internal linking structure? Especially number of internal links pointing to pages
Hi all, We can see the "internal links" in Google webmaster tools where the links pointing to each page will be listed. But this data is not up to date and I also would like to know how competitors are internal linking and which pages of them have most internal links pointing to? So please let me know if there is some tool for this. Thanks
Other SEO Tools | | vtmoz0 -
Best Keyword tool with global search numbers
I am curious to hear from Moz community about the best keyword tool right now which gives most accurate numbers as Google is hiding the numbers. I have used few tools which allows us to check volume for different countries; but would like to know which tool even has the global search volume & search volume for "multiple" selected countries. Thanks
Other SEO Tools | | vtmoz0 -
Which Meta Description Tool is the best??
I use Moz's title tag tool, as I've compared it against titles on Googles and it always correct. But I haven't found a good one for the description. I've tried the two below, but on occasions, they've gotten it wrong. Can anyone suggest a better one?? https://www.portent.com/serp-preview-tool http://www.seomofo.com/snippet-optimizer.html Thanks:)
Other SEO Tools | | MissThumann0 -
What are the best tools for keyword research?
I am kind of new to SEO. I'm wondering what are the best tools that I can use in my keyword research? Any suggestions?
Other SEO Tools | | ahmetkul0