Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I am looking to find the top pages based on traffic volume on my competitors websites, does anyone know of any good resources?
I want to know how which pages on my competitors websites are the most popular based on the traffic volume. I do not care how many links or directed to that page or any other metric. Only thing I am looking for is the traffic volume. It would also be nice to know the length of time spent on that page.
Competitive Research | | kanteenboy0 -
Methods for estimating competitor website traffic from natural search
Hi all, I'm currently working on some competitor analysis and estimating website traffic based on rankings and estimated search volume for approximately 500 keywords. I'm then estimating based on click through rate from Webmaster tools. I think this will give me a relatively accurate estimation but was wondering how everyone else does this? Any other methods out there? Thanks, Elias
Competitive Research | | A_Q0 -
Can anyone explain to me why this website is top of the listings?
Hi folks, Since the latest penguin update, this website: <cite class="bc">www.sterlingbuild.co.uk</cite> is now appearing top of the listings for most 'Velux' related search terms e.g. velux windows, velux, velux windows online. I say top, VELUX themselves are actually top but then Sterling Build are top of all the other retailers that sell VELUX Windows. Why? Their link profile is appalling, the website is no better than their competitors as far as I can tell, their prices are more expensive - it makes no sense? Would be very grateful if anyone can work out why Google has decided they have the best website? Thanks, Luke
Competitive Research | | LukeyB300 -
Finding Local SERPs
Good Afternoon Everyone, I am looking into finding a tool that can use different IP addresses for local markets to find what their SERPs look like for searches such as: Cogs in Calgary Cog Installer Miami Cog Repair New York With local IP addresses for that search in that market. Not sure if such a thing exists, but thanks in advance!
Competitive Research | | RandyEpp0 -
Ecommerce Website Product Rich Snippet Image
Greetings Mozzers, I'm working on an ecommerce site and my goal is to have the product rich snippets on each of them however, I would like an image to start displaying in the SERPs. Looking for some guidance on this issue. Here is a well phrased questioned I found that sums up my thoughts: Product schema has the "image" attribute, but it is not displayed in rich snippets in SERP. However, there is recipe schema and it allows to show image directly on SERP. It means that we can define two entities on a page (product and recipe, it is allowed) and it should display an image from recipe's part + the rest of information (price, availability) from product's part. I know it is a dirty hack and semantically incorrect, but will it work? If so, would it affect rankings or not? Any other drawbacks? Thank you for any advice/clarification!
Competitive Research | | MonsterWeb280 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
How to find a neutral rank for a webpage a keyword term?
Hi!
Competitive Research | | lilactree
I'm sure this has been answered here already - I'm just not searching for the right words. I'm trying to find the ranking for a website for specific terms. Being that the search engine remembers what I search (I try to log out, privately browse, etc), everything matters and impacts my search. I'm trying to see what a website ranks for a person who has never visited that website before, or doesn't have other factors influencing the result. I tried the keyword research tool, and while that seems to deliver what I'm after, it only gives 1-10. Even though these are the coveted positions 😉 I'd like to know if a website isn't ranking there, and is further down. We track the progress made after work is done to a page, to see if it moves up, and what other tweaks we need to make to improve the rankings and attract clicks. Thanks!0 -
I would like suggestions for winery websites
Has anyone on here worked for, or simply know of a high authority winery website? I may have the opportunity to do some work for a vineyard/winery. Obviously there are certain universal seo tactics that I will use on the site, however my knowledge of wine is limited, so I would like some suggestions for, well deigned and seo optimized sites to study and learn from. Any suggestions?
Competitive Research | | NerdsOnCall0