Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO newbie here - I cannot seem to find the direct answers to a few queries that I have
Hi, Apologies if these are very simple queries, but I cannot seem to find the answers anywhere. I understand meta keywords are pretty much pointless nowadays, however when I run a report on another 'keyword website' - my website only ranks for around 2k keywords where my competitors rank for much more (around 20k). I was just wondering where these keywords are found, as I can only assume that these are meta keywords? The company that I'm working on the SEO for is a holiday agency that specialises in holidays abroad for disabled people, so that means that we have a niche product/service and whilst we rank fairly high for some keywords, we would like to rank higher. How is it possible to work towards ranking higher for particular keywords? When doing keyword research 'disabled holidays' has a lot more search traffic than 'accessible holidays'. We are called Enable Holidays and our main competitors have the words 'disabled' and 'accessible' in their domain's, so I would imagine that it's going to be hard to potentially rank higher than our competitors for these keywords? Could someone put me in the right direction of how you improve rankings in the SERP for certain keyword searches? For example, do we have to write more content on a certain page about a keyword? Do we have to include more long-tail keywords in the content? Any help is appreciated. Thanks
Competitive Research | | enableholidays0 -
Best way to find the highest ranking pages for a message board?
What is the best tool or method to find the highest ranking posts and content on a message board or forum? What is the best tool or method for finding the highest ranking keywords for a message board or forum?
Competitive Research | | Hondaspeder0 -
How can I track relevant websites my visitors are viewing?
I'm wanting to build a in-depth profile for my company's typical site visitor and I was wondering if there is anyway to view other websites that visitors are searching for online to get an idea of their hobbies/interests and how they spend their free time. I'm not sure if I'm asking the right questions in Google because the results are very broad and are more about reading analytics for your own company. Can anyone point me to a website or software that allows for this sort of thing?
Competitive Research | | CleanEdisonInc0 -
Why is our website ranked lower but beats most competitors in full SERP report?
We are analysing why our website ranks so low (currently position 8 in serp). We beat our competitors in most areas. Also we produce by far the most useful content. Do not buy links or do any other malpractice. We have been for a long time ranked in top 3 (well mostly 1-2) positions. In the last year we have seen a decline to position 8-10 and we are not sure why this is the case. Can anyone suggest what we should be focusing on? We are clueless. All the practices we used to "know" now seem obsolete. m8qIeyC,Kf1LLei#0
Competitive Research | | urkeman0 -
How does my competitor website jump from a natural ranking of 10 to 1 in a matter of days?
OK this has really got me baffled, and I really hope the MOZ community can give me the answers I am seeking.... My statements and queries below are my own opinions and thoughts. I am not an experienced SEOer and I am learning all the time, so if I have written something incorrectly, please feel free to correct me 🙂 I have been told that natural rankings take time, and I have read with the recent algorithm changes from Google, that purchased links do not have an effect like they used to. I have also read somewhere that google has clamped down on bogus article writing (MOZ please clarify) But what I am seeking some clarification on is, how does my competitors website, that has had a natural rank of #1 in the past, suddenly drop off; for a lengthy period of time, then suddenly re-appear at #10 on page #1, then some three/four days later, hit #1? I have read that natural rankings are purely natural. I.e. a domain owner cannot pay google to boost their natural ranking. But is this really true? Why is it when I speak to a close colleague of mine in the same industry, he mentions that his maps listing has dropped off, and after making a couple of phone calls to his SEO guys in India, maybe a day or two later, magically his maps re-appear? I really am starting to question is a "natural ranking" really "natural?" I have heard that some of these SEO agencies do have some tools that dramatically effect the natural ranking of a domain. What are these tools?
Competitive Research | | Giorgio680 -
Free tools to find country of origin of backlinks/urls
Hey are there any free tools out there which can allow me to insert a large list of urls, and it determines the country of origin of the domain. I know the paid version of majestic does, but i was wondering if theres any free tools? Cheers, Chris
Competitive Research | | monster990 -
Free tools to discover traffic for a website?
Are there any free tools to learn traffic data (especially organic traffic data) from a site or blog?
Competitive Research | | nicole.healthline0 -
I would like suggestions for winery websites
Has anyone on here worked for, or simply know of a high authority winery website? I may have the opportunity to do some work for a vineyard/winery. Obviously there are certain universal seo tactics that I will use on the site, however my knowledge of wine is limited, so I would like some suggestions for, well deigned and seo optimized sites to study and learn from. Any suggestions?
Competitive Research | | NerdsOnCall0