Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Selling on eBay and Amazon, does it have a negative impact our your website?
_We sell on multiple platforms I.e own website, eBay, Amazon and have noticed over the last few years to hold a page 1 ranking on Google is becoming more and more difficult as the SERPs are saturated with the big brands. _ My question is, we've loaded all of our products and there lovely unique descriptions to eBay and Amazon, is there any chance that this content is helping eBay and Amazon rank (may be not by much!), but certainly not doing us any favours. As effectively why would you show our site in the search results for a product range, when all of the content/products already appear on eBay/Amazon which is several SERPs places higher? Is Google not inclined to think, "hey no need to show x site, as the content is already features on Amazon, why show it twice?" Any one have any thoughts?
Competitive Research | | bnknowles10 -
I am looking to find the top pages based on traffic volume on my competitors websites, does anyone know of any good resources?
I want to know how which pages on my competitors websites are the most popular based on the traffic volume. I do not care how many links or directed to that page or any other metric. Only thing I am looking for is the traffic volume. It would also be nice to know the length of time spent on that page.
Competitive Research | | kanteenboy0 -
Why is our website ranked lower but beats most competitors in full SERP report?
We are analysing why our website ranks so low (currently position 8 in serp). We beat our competitors in most areas. Also we produce by far the most useful content. Do not buy links or do any other malpractice. We have been for a long time ranked in top 3 (well mostly 1-2) positions. In the last year we have seen a decline to position 8-10 and we are not sure why this is the case. Can anyone suggest what we should be focusing on? We are clueless. All the practices we used to "know" now seem obsolete. m8qIeyC,Kf1LLei#0
Competitive Research | | urkeman0 -
Why is my website not in the top 3 if our Moz statistics are better?
Hi, We've been using Moz, for our E-commerce sites, for some time now and are improving all of our statistics, be it on-page for specific keywords or general crawl errors, but I've not been seeing a lot of change in our rankings... (we've moved from place 7 to 6 on our main keyword). I'm thinking of looking at our backlinks, through Link Detox, after we finish our Moz optimisation to see if anything weird is going on with that. Are there any other areas I should be looking at? any other clues as to why we're not ranking higher than our competitors. Even if our Moz statistics are better and our Market Samurai values are similar? Thank you very much! Alexander
Competitive Research | | WebmasterAlex1 -
Creating Free Website Accounts (Weebly, Wix, Wordpress.com, etc) for Linking Purposes?
Greetings Mozzers, I came a cross several sites and when looking at their link profile I found they had several links from these free services to gain links. Obviously duplicate content is bad, but if all the content on each one was completely unique, would these links be of quality? Let's say, 1 link per site that is external to your site. I know it's a tricky topic but just wanted thoughts, would the above be a potentially beneficial method for gaining a simple quality link. Your advice and information is much appreciated!
Competitive Research | | MonsterWeb280 -
Website Neighborhood Tool
Hello,
Competitive Research | | Ric
Do you know a tool where you can find other websites with the same Adsense code or Analytics Code? Thanks, Eric0 -
How to calculate the most powerful websites in my industry?
Hi, I would like to do some research and put together a post on the most powerful websites in my industry, and was wondering if you have any advice on how to calculate this - or if there is a tool available? Rather than making assumptions, I would like to try and be as accurate as possible. Thanks in advance for suggestions.
Competitive Research | | juiceD0 -
Help with website
Hello, I've been trying to get our website on 1st place (or at least 1st page to start) on several keywords, on google in all English speaking countries. In most of them I managed, but in USA I'm on 5th page. By Domain Analysis we are better than competition. Keywords are glass nail files, crystals nail files (some long tail keywords are ok, we are somewhere on top). Website: http://www.czech-glass-nail-files.com/ We worked on code, design (notice issues is just recent, because of server migration), on-page, blog. Can someone help me out with an advise? The goal is to be #1. We definitely doing something wrong, but I can't figure out what. Thank you.
Competitive Research | | divan0