Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pre Launch New Website SEO Best Practices
Hi All, I am currently mid development of a website (no testing page yet) and want to make sure I am doing my due diligence in regards to SEO. Are there best practices to always complete while a website is being built? If so what are they? I've gotten to the stage where I've read every blog on the planet and now maybe too much info. I am also focusing my Keyword Analysis around competitor research to write great copy from, but seem to be falling down a rabbit hole of way too many keywords. Is there agencies/services that would just be hired to do Keyword Research for my needs? Thanks a lot!
Competitive Research | | Krackle0 -
Why is my website not in the top 3 if our Moz statistics are better?
Hi, We've been using Moz, for our E-commerce sites, for some time now and are improving all of our statistics, be it on-page for specific keywords or general crawl errors, but I've not been seeing a lot of change in our rankings... (we've moved from place 7 to 6 on our main keyword). I'm thinking of looking at our backlinks, through Link Detox, after we finish our Moz optimisation to see if anything weird is going on with that. Are there any other areas I should be looking at? any other clues as to why we're not ranking higher than our competitors. Even if our Moz statistics are better and our Market Samurai values are similar? Thank you very much! Alexander
Competitive Research | | WebmasterAlex1 -
Finding Local SERPs
Good Afternoon Everyone, I am looking into finding a tool that can use different IP addresses for local markets to find what their SERPs look like for searches such as: Cogs in Calgary Cog Installer Miami Cog Repair New York With local IP addresses for that search in that market. Not sure if such a thing exists, but thanks in advance!
Competitive Research | | RandyEpp0 -
Thoughts on Nofollow My Account / Shopping Cart Pages on an eCommerce Website
I recently noticed most of my competitors (eCommerce sites) have linked to pages within their sites that do not always contain product information (my account, shopping cart, etc) using rel="nofollow". My site does not currently do this. Are there any advantages to using rel="nofollow" on similar pages on our site? Any disadvantages?
Competitive Research | | Gordian0 -
Free tools to find country of origin of backlinks/urls
Hey are there any free tools out there which can allow me to insert a large list of urls, and it determines the country of origin of the domain. I know the paid version of majestic does, but i was wondering if theres any free tools? Cheers, Chris
Competitive Research | | monster990 -
How do I find the best converting keywords
I rank decently on local search for some of my keywords but find that the traffic coming to my site is not from those keywords. I also find that they never convert to sales queries. Is someone able to help me out with that? Thanks My domain is www.hykano.com
Competitive Research | | Skwtayler0 -
How to find all the backlinks of a website?
Hello, I would like to know if there is a tool or a way to find all the backlinks of a website in order to understand how this site does get traffic? Thanks, JD
Competitive Research | | sarenausa0