Sitemap Size effect SEO
-
So I've noticed that the sitemap I use has a capacity of 4500 URLs, but my website is much larger. Is it worth paying for a commercial sitemap that encompasses my entire site?
I also notice that of the 4500 URLs which have been submitted, only 104 are indexed. Is this normal, if not, why is the index rate so low?
-
As Thomas said, 50k is the max but you can also have an index file with multiple sitemaps within it so you can have lots more if needed. A couple of things I would add.
- Manual crawling is fine but remember, that also means that pages that can't be crawled will be excluded from the sitemap which defeats the purpose of the sitemap
- As for why the indexation levels are so low, the first thing I would check is if everything in the sitemap is a 200 response. Make sure there aren't any redirects or 404s otherwise Google may decide not to trust the sitemap.
I hope this helps
-
Sitemaps can go up to 50,000 urls, so 4500 isn't an issue for Google to handle.
https://support.google.com/webmasters/answer/183668?hl=en
Just to add on to Bernadette's post, this section "If your website's CMS can't do that, then I would recommend crawling the website yourself and updating the sitemap file. However, keep in mind that if you do it manually then you'll need to update it whenever you add or remove a page on the website." You can use something like Screaming Frog for this if you were wondering what software to use. It's a very common tool for an SEO to use, so hopefully you'll have it to save purchasing a license to something else.
-
Spacecollective, your website's sitemap file(s) don't have any direct impact on search engine rankings. If you have a large website with over 4500 URLs, then most likely you're using content management system (CMS) that "should" be able to create a sitemap file.
If your website's CMS can't do that, then I would recommend crawling the website yourself and updating the sitemap file. However, keep in mind that if you do it manually then you'll need to update it whenever you add or remove a page on the website.
Typically, if your navigational structure is set up in a way that all pages on the website can be crawled via links on the site, you generally shouldn't have anything to worry about.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sitemaps, 404s and URL structure
Hi All! I recently acquired a client and noticed in Search Console over 1300 404s, all starting around late October this year. What's strange is that I can access the pages that are 404ing by cutting and pasting the URLs and via inbound links from other sites. I suspect the issue might have something to do with Sitemaps. The site has 5 Sitemaps, generated by the Yoast plugin. 2 Sitemaps seem to be working (pages being indexed), 3 Sitemaps seem to be not working (pages have warnings, errors and nothing shows up as indexed). The pages listed in the 3 broken sitemaps seem to be the same pages giving 404 errors. I'm wondering if auto URL structure might be the culprit here. For example, one sitemap that works is called newsletter-sitemap.xml, all the URLs listed follow the structure: http://example.com/newsletter/post-title Whereas, one sitemap that doesn't work is called culture-event-sitemap.xml. Here the URLs underneath follow the structure http://example.com/post-title. Could it be that these URLs are not being crawled / found because they don't follow the structure http://example.com/culture-event/post-title? If not, any other ideas? Thank you for reading this long post and helping out a relatively new SEO!
Technical SEO | | DanielFeldman0 -
SEO problem: wrong language sitelinks
The French and German version of my web site are showing mixed language sitelinks I have no idea how to fix this now that Google have remove demote sitelinks feature, how can I make sure only the german site links appear in the german version of the site and french site links only appear in the french version of the site? www.mercimamanboutique.com/de-de/ www.mercimamanboutique.com/fr-fr/ Thanks again
Technical SEO | | ss20160 -
Global Product Tabs and SEO
I am looking at a site that has global or duplicated content in 4 tabs for things like shipping, quality etc on tabs on each product page. The content is very good for UX and helps conversions but poor for SEO. Each product page has unique and tagged photos, unique title and a unique description. Is there away to specifically tell search engines that individual parts of a page are duplicated for good reason? Linking to the content to a single page decreases conversion dramatically but having it on tabs could effect ranking and quality as it is duplicated. Can anyone offer any advice with this?
Technical SEO | | Ian_W0 -
SEO implications of network outage
Hi, Our bandwidth provider has informed us of a forthcoming network outage this weekend, the net result being that around 20 websites will be unreachable for a total of about 1 hour inside a predetermined 3 hour window.In an ideal world we would like to provide a holding page or be able to respond with a "503 Service Temporarily Unavailable" HTTP code, however the complete absence of connectivity means we'll be unable to do this.Does anyone have any ideas about the SEO implications of this kind of downtime? It would be useful to know if there are any actions we can take prior to the outage that could mitigate the impact. We've considered repointing the DNS to other servers, but it's only something we'll do if the negative impact of not doing it is too great.Thanks in advance!
Technical SEO | | Dave3920 -
Does "?" in my URL have a negative effect?
I am having a difficult time finding specific information about the effect, if any, having a ? within the URL structure. We have the descriptive keyword phrase followed by the ? location id as in this example: http://www.adventuresonly.com/adventure-locations/things-to-do-in-arizona?stateid=124 Any feedback on effect and a corrective process to improve if necessary would be appreciated!
Technical SEO | | RBBonds0 -
What sitemap generator for mac for php web
i would like to generate a sitemap for my web, and i have mac computer, can you advise me about what site map use
Technical SEO | | maestrosonrisas0 -
All in One SEO weirdness
For some reason, I'm getting extra words in my title tags. For example, I wrote "Washing Machine Widgets | Acme Widgets, Inc. | Acme Widgets Inc. Anyone have any idea why I'm getting the extra " | Acme Widgets Inc."? Thanks!
Technical SEO | | PGD20110 -
SEO Developers
I have a team of inexperienced SEO developers and the argument we continually have is that its a marketing role - however most of it is technical, no view state, no js, page load time, csssprite, metatags, frequency of updates to server, duplicate content via coding methodology, lioading content prior to ads, not spidering ads (IT says impossible yet google says required) etc. I looked at your referrals for developers and couldnt find any that recognized SEO as part of their skill set - do you believe tehre aer developers that specialize in this? Thanks, Michelle
Technical SEO | | Silly8880