Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Finding most popular sites within a category - who offers that information?
Hello Mozzers - I am researching the most popular sites within a category - are there any services that identify the most popular sites within a category - I noticed Alexa do offer a service but I have no idea who else offers such a service (Majestic, perhaps?). Thanks in advance, Luke
Competitive Research | | McTaggart0 -
Pre Launch New Website SEO Best Practices
Hi All, I am currently mid development of a website (no testing page yet) and want to make sure I am doing my due diligence in regards to SEO. Are there best practices to always complete while a website is being built? If so what are they? I've gotten to the stage where I've read every blog on the planet and now maybe too much info. I am also focusing my Keyword Analysis around competitor research to write great copy from, but seem to be falling down a rabbit hole of way too many keywords. Is there agencies/services that would just be hired to do Keyword Research for my needs? Thanks a lot!
Competitive Research | | Krackle0 -
Pagerank and sitemap question :)
As most of us are, I am working on pushing my page rank up and in that I have been looking at some of the pages ahead of me to see what they may be doing. I noticed one of my main competitors has some different sitemaps than I am using. My sitemaps consist of:
Competitive Research | | allstatetransmission
Using Yoast WP PLugin:
Posts
Pages
QA/FAQs
Testimonials
Categories
and FAQ Categories Using Google Images Sitemap WP Plugin:
Images Sitemap http://1stimpressions.com/sitemap_index.xml Their sitemap has:
Posts
Pages
Attachment
Portfolio (Next Gen Gallery)
Category
Post Tags
Next Gen Gallery (NGG) Tags
Portfolio Type Sitemap
Author Sitemap http://smartwrap.com/sitemap_index.xml Could adding in some of these sitemaps help in page rank? I have looked at their links and on page optimization and we are just about par in comparison if not ahead of them, but they still are a whole page ahead of us in google searches for phoenix vehicle wraps, or car wraps phoenix and related searches. Thanks for your input, I really appreciate it. 🙂 Cheers! (edited spelling)0 -
Thoughts on Nofollow My Account / Shopping Cart Pages on an eCommerce Website
I recently noticed most of my competitors (eCommerce sites) have linked to pages within their sites that do not always contain product information (my account, shopping cart, etc) using rel="nofollow". My site does not currently do this. Are there any advantages to using rel="nofollow" on similar pages on our site? Any disadvantages?
Competitive Research | | Gordian0 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
Where do we find a Keyword Discovery Tool in SEOmoz?
I've been looking for a way to compare keywords amongst my competition websites.
Competitive Research | | homesonthesound0 -
How do I know top pages (first on Google) for one website?
Hi! I'm SEOMOZ PRO user and I want to know which pages of other website are ranking on top on Google, Yahoo, Bing, ecc... with relative position (rank). Is there a features of SEOMOZ for it? Regards
Competitive Research | | jadlib0 -
Website Neighborhood Tool
Hello,
Competitive Research | | Ric
Do you know a tool where you can find other websites with the same Adsense code or Analytics Code? Thanks, Eric0