How to create XML sitemap for larger website?
-
We need to create XML sitemap for a website that has more than 2 million pages. Please suggest me the best software to create XML sitemap for the website.
Since there are different strategies that larger websites submit sitemaps, let me know the best way to submit this sitemap for website of this size.
Or Is there any tool provided by SEOmoz for XML sitemap generation for larger websites?
-
Thanks a lot for your suggestion. We have successfully run 500 URI limit using trial version of this Screaming Frog software. We will check up with the licensed version of the software.
-
Our website is built with ASP and there is no plugin/extension for XML sitemaps
-
Screaming Frog is quite good I seem to remember, it will crawl all your URL's then create the sitemap for you. You may need to change the "priority" of the pages but the hard work is pretty much done for you.
-
What's the website built with? Doesn't it have a module/plugin/extension for XML sitemaps?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website Redesign - Duplicate Content?
I hired a company to redesign our website.there are many pages like the example below that we are downsizing content by 80%.(believe me, not my decision)Current page: https://servicechampions.com/air-conditioning/New page (on test server):https://servicechampions.mymwpdesign.com/air-conditioning/My question to you is, that 80% of content that i am losing in the redesign, can i republish it as a blog?I know that google has it indexed. The old page has been live for 5 years, but now 80% of it will no longer be live. so can it be a blog and gain new (keep) seo value?What should i do with the 80% of content i am losing?
Intermediate & Advanced SEO | | CamiloSC0 -
How do I fix my sitemap?
I have no idea how this happened, but our sitemap was http://www.kempruge.com/sitemap.xml, now it's http://www.kempruge.com/category/news/feed/ and google won't index it. It 404's. Obviously, I had to have done something wrong, but I don't know what and more importantly, I don't know how to find it in the backend of wordpress to change it. I tried a 301 redirect, but GWT still 404'd it. Any ideas? And, it's been like this for a few weeks, I've just neglected it, so I can't just reset the site without losing a lot of work. Thanks, Ruben
Intermediate & Advanced SEO | | KempRugeLawGroup0 -
Urls missing from product_cat sitemap
I'm using Yoast SEO plugin to generate XML sitemaps on my e-commerce site (woocommerce). I recently changed the category structure and now only 25 of about 75 product categories are included. Is there a way to manually include urls or what is the best way to have them all indexed in the sitemap?
Intermediate & Advanced SEO | | kisen0 -
Footer link - Created by
Hi everyone We created a website for our customer, and we wanted to have a footer link: "Created by WebPerfection.biz" Some Marketing company advised our customer, that it will hurt their SEO if they have that link for us in footer Would you guys advice on this please? Thank you P.S. site for our customer: www.azsedans.com
Intermediate & Advanced SEO | | DavidIRC0 -
Website architecture and sitewide link
Hello, I was reading this article about website architecture http://www.seomoz.org/blog/site-architecture-for-seo and I have a question about site wide link... I don't think site wide link are good if you want your homepage to have the most " juice " can someone confirm that to me. What I mean by site wide link is let's say I have a page about golf in califorina and I create a link to another page of my website which is about golf in florida that a good practicee to do that or not ? I just used this calculator http://www.webworkshop.net/pagerank_calculator.php and and if I do site wide links the juice doesn't go to my most important page ( the homepage ) which is the one I currently want to have the most juice. However, I noticed that website like amazon do site wide link let's say you are looking at a book and they have lots of links for other books or categories and they still rank very well for the word "textbooks" so I am kind of lost and don't understand why they still rank even though to me their juice goes away by doing site wide links to other books or categories ( even though it is related ) Can someone tell me more about site wide links are they good , bad etc... and is this calculator I use right or wrong ? Thank you
Intermediate & Advanced SEO | | seoanalytics0 -
Sitemaps: Alternate hreflang
Hi, some time ago I have read that there is a limit of 50.000 URLs per sitemap file (So, you need to create a sitemap index and separate files with 50.000 urls each). [Source]. Now we are about to implement the link hreflang in the sitemap [Source], and we dont know if we have to count each alternate as a different url. We have 21 different well positioned domains (Same name, different cctlds, a little different content [varies in currencies, taxes, some labels, etc] depending in the target country) so the amount of links per url would be high. A) Shall we count each link alternate as a separate url, or just the original ones? For example, if we have to count the link alternates, that would make us have 2380pages per sitemap, each with one original url and 20 alternate links. (Always being aware of the 50mb maximum filesize) B) Actually we have one sitemap per domain. Using this, shall we generate one per domain using the matching domain as original url? Or it would be the same if we upload to every domain the same sitemap? Thanks
Intermediate & Advanced SEO | | marianoSoler980 -
Multiple sitemaps for one site?
Excuse my sitemap ignorance here. I've got a site and it's got a blog in a sub-folder. The blog gets updated frequently, the main site does not. Is it best to; a) Have 2 sitemaps.. one in the root and one in the /blog folder. b) Have 1 sitemap that is regularly updated The reason being, I know there's various plugins that create blog sitemaps on the fly, so that would be much easier than updating the main sitemap every time a change was made. If the answer is 2 sitemaps; Would you stop the root sitemap from detailing the contents of the blog folder or just update it every so often with the contents of the blog folder?
Intermediate & Advanced SEO | | PeterAlexLeigh0 -
Redirecting multiple websites to a single website
I've been trying to run several truck accessory affiliate websites for a quite a while now. I've recently decided to combine all of my affiliate websites into a single community website. This way I'll be able to focus all my energy and link building into a single place and build up a single brand. My question is, how many websites do I try to redirect to the new website at a time? Do I need to spread this out? Or is it ok if I move all of my content and websites at a single time? I have around 30 websites that I could move to this new domain. Thanks! Andy
Intermediate & Advanced SEO | | daenterpri0