Find archived sitemap of a website that no longer exists
-
I am trying to figure out the site structure of a website and the urls of all the pages. Normally this would be easy but a couple of months ago the website went down and I don't think it will ever come back. Any help would be appreciated.
-
Use the internet archive (wayback machine) which effectdigital mentioned above, to find the /robots.txt file from the desired date. In that file you should find the referenced sitemap file (assuming the site properly included its sitemap reference in its robot.txt file). Then you can use the same process to request the sitemap file which was referenced in the robots.txt file.
-
Hi Effect,
Does your second link automatically provider the sitemaps available, or does the user still need to "know" or be able to guess where they might be e.g /sitemap.xml?
Nick
-
You can use this site to see legacy site-maps for some websites (though they may be partial or incomplete):
For example, check these sitemap results:
For smaller sites, the results are much easier to look at.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How do we find keyword opportunities - but not just against 3 competitors...
Hello everyone! How can I find out what might be a keyword opportunity against a competitor but make sure it's still a realistic opportunity in SERPS generally?* After all, we are not just competing with 2 or 3 competitors. We are competing against everyone! Perhaps there is a part of the keyword research process that helps? I can't help but think there's a wasted effort to just beat a couple of competitors unless you can rank well generally - especially if it's a competitive sector. (*I'm not in the position of making lots of pages as part of a long-tail keyword/ content strategy so I need to focus on just a few and make them count) Thanks in advance. Mp
Competitive Research | | mark_seomoz10 -
Why my website's Alexa rank is dropping
My website Alexa rank has dramatically dropped in the past 3 months: Website: www.sastasundar.com End of July, 2012: 5217 Global, 265 Local(India) But Now: ** 29260** Global, 2274 Local(India) Definitely something big has affected my global ranking and I'm not able to figure it out. Please help.
Competitive Research | | foreseegame0 -
Finding new links to site
Is there a way to find sites that linked to my site during a certain time period? Say in the past 2 weeks or from March 1-March 15th ?
Competitive Research | | priceseo0 -
Should I set up multiple websites with keywords in the domain?
I work for an e-commerce brand that manufactures sells 2-3 uniform products for medical professionals. Of course, we set out originally using our brand name as our domain name, and we will continue down that path. However, our best products are the premium lab coats we sell, and we're currently facing an uphill battle for the keyword combo, "lab coats" which is 44% competitive. In our ranking analysis, we can see that we're up against 2 major competitive forces: extremely high domain authority (i.e. Amazon & Ebay), and stores that have the phrase "lab coats" or the word "lab" in their domain name. We recently dropped the hosting package we had with the domain www.scrubsandlabcoats.net (which was redirecting to our primary domain) and our ranking dropped almost immediately afterwards. We put that site back up and now 301 redirect it to our main site but it doesn't look like we restored whatever it was that was in place on that site (before my time) because our rankings haven't improved back to where they were a few months ago. Question is: Would it make sense to purchase a domain with the combination of our brand name and the words "lab coats" and then put up a few pages with links to our top productus OR would that be no more effective than what we already have in place (www.ourdomain.com/lab-coats.html)? Also, any guesses on what kind of crazy set up we used to have on that other domain (scrubsandlabcoats.net) that was helping us in the past? Really appreciate the help!
Competitive Research | | dstepchew0 -
Query for checking is a link to domain A already exists on domain B
Hi, I was wondering if anyone can help. I need to have a simple check where I have 2 domains, and I can check of there are any links from domain A to domain B. Does anyone what would be the best query for this and if you would use google, bing, yahoo or other SE. Many thanks
Competitive Research | | James770 -
Analyzing Back Links - Says site A has back link to Site B but when I look at site B I can't find any back link to Site A. Why?
I am new to SEO Moz - It looks like incredible technology. I was playing around with different websites to see where they had back linked to see how it works. Looked at a site called racingsecretsexposed [dot] come and it said that it had dozens of links to www.ndesignstudio.com such as: ndesign-studio.com/blog/best-wordpress-sites?replytocom=893 with link anchor text "laying horses" but when I do a search for the company name, or the anchor text "laying horses", or the owner of the company's name on ndesignstudio.com - nothing appears. Why not? Isn't the back link anchored by the text laying horses, which should link back to the racing secrets website? Thanks
Competitive Research | | NewtoSEO900 -
Competitor Ranking High has 2 Domains, But Duplicate Website ?
I was using OSE and noticed all the backlinks to one of our competitors is there other domain name, which is the EXACT SAME website. You can enter both url's and they display the same content. They are not useing any canonical tags either. Why are they not penalized for duplicate content? And for using there own website for backlinks ? We try to do everything right, but still cannot beat them. Any thoughts on this?
Competitive Research | | hfranz0 -
50,000 Links From The Same Website
Hey Mozers, I was conducting competitive research for a client of mine and I discovered one of their competitors has over 50,000 backlinks! After removing my heart from my stomach I realized that 99.9% of the links came from a single website that doesn't have nearly that many pages. Has anyone experienced this in the past? And if so what exactly is going on? C
Competitive Research | | calindaniel0