Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I track where visitors go after exiting my website?
I don't want to track external links. I just want to know where they go when they leave. Is that possible? Can I do this with a cookie?
Competitive Research | | Vacatia_SEO0 -
Methods for estimating competitor website traffic from natural search
Hi all, I'm currently working on some competitor analysis and estimating website traffic based on rankings and estimated search volume for approximately 500 keywords. I'm then estimating based on click through rate from Webmaster tools. I think this will give me a relatively accurate estimation but was wondering how everyone else does this? Any other methods out there? Thanks, Elias
Competitive Research | | A_Q0 -
Can anyone explain to me why this website is top of the listings?
Hi folks, Since the latest penguin update, this website: <cite class="bc">www.sterlingbuild.co.uk</cite> is now appearing top of the listings for most 'Velux' related search terms e.g. velux windows, velux, velux windows online. I say top, VELUX themselves are actually top but then Sterling Build are top of all the other retailers that sell VELUX Windows. Why? Their link profile is appalling, the website is no better than their competitors as far as I can tell, their prices are more expensive - it makes no sense? Would be very grateful if anyone can work out why Google has decided they have the best website? Thanks, Luke
Competitive Research | | LukeyB300 -
Ecommerce Website Product Rich Snippet Image
Greetings Mozzers, I'm working on an ecommerce site and my goal is to have the product rich snippets on each of them however, I would like an image to start displaying in the SERPs. Looking for some guidance on this issue. Here is a well phrased questioned I found that sums up my thoughts: Product schema has the "image" attribute, but it is not displayed in rich snippets in SERP. However, there is recipe schema and it allows to show image directly on SERP. It means that we can define two entities on a page (product and recipe, it is allowed) and it should display an image from recipe's part + the rest of information (price, availability) from product's part. I know it is a dirty hack and semantically incorrect, but will it work? If so, would it affect rankings or not? Any other drawbacks? Thank you for any advice/clarification!
Competitive Research | | MonsterWeb280 -
Creating Free Website Accounts (Weebly, Wix, Wordpress.com, etc) for Linking Purposes?
Greetings Mozzers, I came a cross several sites and when looking at their link profile I found they had several links from these free services to gain links. Obviously duplicate content is bad, but if all the content on each one was completely unique, would these links be of quality? Let's say, 1 link per site that is external to your site. I know it's a tricky topic but just wanted thoughts, would the above be a potentially beneficial method for gaining a simple quality link. Your advice and information is much appreciated!
Competitive Research | | MonsterWeb280 -
Help with website
Hello, I've been trying to get our website on 1st place (or at least 1st page to start) on several keywords, on google in all English speaking countries. In most of them I managed, but in USA I'm on 5th page. By Domain Analysis we are better than competition. Keywords are glass nail files, crystals nail files (some long tail keywords are ok, we are somewhere on top). Website: http://www.czech-glass-nail-files.com/ We worked on code, design (notice issues is just recent, because of server migration), on-page, blog. Can someone help me out with an advise? The goal is to be #1. We definitely doing something wrong, but I can't figure out what. Thank you.
Competitive Research | | divan0 -
I would like suggestions for winery websites
Has anyone on here worked for, or simply know of a high authority winery website? I may have the opportunity to do some work for a vineyard/winery. Obviously there are certain universal seo tactics that I will use on the site, however my knowledge of wine is limited, so I would like some suggestions for, well deigned and seo optimized sites to study and learn from. Any suggestions?
Competitive Research | | NerdsOnCall0 -
How to find all the backlinks of a website?
Hello, I would like to know if there is a tool or a way to find all the backlinks of a website in order to understand how this site does get traffic? Thanks, JD
Competitive Research | | sarenausa0