Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO newbie here - I cannot seem to find the direct answers to a few queries that I have
Hi, Apologies if these are very simple queries, but I cannot seem to find the answers anywhere. I understand meta keywords are pretty much pointless nowadays, however when I run a report on another 'keyword website' - my website only ranks for around 2k keywords where my competitors rank for much more (around 20k). I was just wondering where these keywords are found, as I can only assume that these are meta keywords? The company that I'm working on the SEO for is a holiday agency that specialises in holidays abroad for disabled people, so that means that we have a niche product/service and whilst we rank fairly high for some keywords, we would like to rank higher. How is it possible to work towards ranking higher for particular keywords? When doing keyword research 'disabled holidays' has a lot more search traffic than 'accessible holidays'. We are called Enable Holidays and our main competitors have the words 'disabled' and 'accessible' in their domain's, so I would imagine that it's going to be hard to potentially rank higher than our competitors for these keywords? Could someone put me in the right direction of how you improve rankings in the SERP for certain keyword searches? For example, do we have to write more content on a certain page about a keyword? Do we have to include more long-tail keywords in the content? Any help is appreciated. Thanks
Competitive Research | | enableholidays0 -
How can I find out the exact match visitors for a competitor's website?
Hi, I'm trying to find a way of finding out the estimated number of exact match visitors that a competitor's website has got. I know that SEO agencies can find this out, and there must be a way of doing this for myself. Thanks
Competitive Research | | MThacker0 -
Should I set up multiple websites with keywords in the domain?
I work for an e-commerce brand that manufactures sells 2-3 uniform products for medical professionals. Of course, we set out originally using our brand name as our domain name, and we will continue down that path. However, our best products are the premium lab coats we sell, and we're currently facing an uphill battle for the keyword combo, "lab coats" which is 44% competitive. In our ranking analysis, we can see that we're up against 2 major competitive forces: extremely high domain authority (i.e. Amazon & Ebay), and stores that have the phrase "lab coats" or the word "lab" in their domain name. We recently dropped the hosting package we had with the domain www.scrubsandlabcoats.net (which was redirecting to our primary domain) and our ranking dropped almost immediately afterwards. We put that site back up and now 301 redirect it to our main site but it doesn't look like we restored whatever it was that was in place on that site (before my time) because our rankings haven't improved back to where they were a few months ago. Question is: Would it make sense to purchase a domain with the combination of our brand name and the words "lab coats" and then put up a few pages with links to our top productus OR would that be no more effective than what we already have in place (www.ourdomain.com/lab-coats.html)? Also, any guesses on what kind of crazy set up we used to have on that other domain (scrubsandlabcoats.net) that was helping us in the past? Really appreciate the help!
Competitive Research | | dstepchew0 -
Why does the link analysis of my website say I have no links?
When I click on the "Link Analysis" tab it says my website has a domain authority of 1 and has 0's for every other category. When I run it in Open Site Explorer - it says I have a page authority of 51 with over 4600 links. My website also seems to be at a stand still over the past several weeks. Anyone know why the two Link Analysis is not showing anything? Thank you
Competitive Research | | tyler7560 -
Websites like these..
Hi, I'm new to link building. I have done some research of my competitors and have found that many of them are being linked to sites like this http://www.worldofwondersvu.com/ As you can see, this website looks like a business website, but if you view the content, it's spammed with external links. I'm just wondering what method they are going about to get these links, because most of the websites that are linking to them are simular to the one I posted above! Thanks 🙂
Competitive Research | | LTTVending740 -
How to find a neutral rank for a webpage a keyword term?
Hi!
Competitive Research | | lilactree
I'm sure this has been answered here already - I'm just not searching for the right words. I'm trying to find the ranking for a website for specific terms. Being that the search engine remembers what I search (I try to log out, privately browse, etc), everything matters and impacts my search. I'm trying to see what a website ranks for a person who has never visited that website before, or doesn't have other factors influencing the result. I tried the keyword research tool, and while that seems to deliver what I'm after, it only gives 1-10. Even though these are the coveted positions 😉 I'd like to know if a website isn't ranking there, and is further down. We track the progress made after work is done to a page, to see if it moves up, and what other tweaks we need to make to improve the rankings and attract clicks. Thanks!0 -
How do I find the best converting keywords
I rank decently on local search for some of my keywords but find that the traffic coming to my site is not from those keywords. I also find that they never convert to sales queries. Is someone able to help me out with that? Thanks My domain is www.hykano.com
Competitive Research | | Skwtayler0 -
50,000 Links From The Same Website
Hey Mozers, I was conducting competitive research for a client of mine and I discovered one of their competitors has over 50,000 backlinks! After removing my heart from my stomach I realized that 99.9% of the links came from a single website that doesn't have nearly that many pages. Has anyone experienced this in the past? And if so what exactly is going on? C
Competitive Research | | calindaniel0