Sitemap - What are the recommendations on the number of links
-
Hi,
I have a sitemap(s) which is very large(.i.e. 60000) links, is it recommended to have so many links and how come when I do a site search(site:mydomain) the number of links are less than on my site map?
-
Sitemaps cannot (should not) contain more than 50,000 URLs: https://www.sitemaps.org/faq.html#faq_sitemap_size
I'd recommend you instead create a sitemap index to house multiple sitemap files. Keep in mind you will need to separate the URLs in them in order to represent all 60K URLs you have in your existing sitemap.
Separately, EGOL makes excellent points: sitemaps aren't the only way to get pages indexed. It's entirely possible that you do not have sufficient internal links that aid crawlers' discovery of your content: https://moz.com/learn/seo/internal-link
You may also have directives (e.g. noindex) on certain pages or in your robots.txt that prevents crawlers from crawling and indexing certain parts of your site. It may be time for a technical audit: https://www.distilled.net/technical-seo-audit-checklist/
-
how come when I do a site search(site:mydomain) the number of links are less than on my site map?
There are many causes of poor indexing....
-- if your site does not have very many links, it is possible that Google does not crawl it deeply and completely, and might even forget many of your pages between crawls
-- poor indexing can be caused by a poor site structure, where you have category pages that link to subcategory pages which link to deep pages.... AND, you have lots of internal and external links hitting these category pages to force crawlers deep into your site - where they must chew their way out through a lot of pages
-- also, consider your content... is it unique, substantive, not copy-pasted from other websites... with such problems, Google can choose to ignore your pages
is it recommended to have so many links
That is a lot of links. I would consider two site maps, each with half of our pages, that will get more crawling deep into your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Link externally from destination pages
Hello, From my destinations pages, is it beneficial to have a link going externally to the hotels my clients are staying in ? In other words is it beneficial to my website or will it hurt me to link external from all my destinations pages to all the hotels my clients are staying in ?
Intermediate & Advanced SEO | | seoanalytics0 -
More bad links
Hi, After a recent disastrous dalliance with a rogue SEO company I disavowed quite a few domains (links he had gained) which I was receiving a penalty of about 23 places. I cleaned up the site and added meta descriptions where missing, and deleted duplicate titles and pages. This gained me another 5 places. In the meantime I have been getting a few links from wedding blogs, adobe forums and other relevant sites so was expecting an upward momentum. Since the high point of bottom of page 1 I have slowly slid back down to near the bottom of page two for my main keywords. Just checked my webmaster tools latest links and another 4 domains have appeared (gained by the dodgy SEO) : domain:erwinskee.blog.co.uk domain:grencholerz.blog.co.uk domain:valeriiees.blog.co.uk domain:gb.bizin.eu They all look bad so I am going to disavow. I expect to find an improvement when I disavow these new domains. As I have said, have started using the open site explorer tool to check my competitors backlinks and getting some low level links(I'm a wedding photographer) like forum comments and blog comments and good directories. I know there is much more than this to SEO and plan on raising my game as time progresses. I have also gained more links from the domains I disavowed on the 8th January mostly from www.friendfeed.com. will webmaster tools ignore any new links from previously disavowed domains? Like I have said I know there are better ways to get links, but are these links (forum comments, blog comments and respectable directories) one way of raising my rankings? To be honest that is all my competitors have got other than some of the top boys might have a photograph or two on another site with a link. No-one has a decent article or review anywhere (which is my next stage of getting links). Thanks! David.
Intermediate & Advanced SEO | | WallerD0 -
'Nofollow' footer links from another site, are they 'bad' links?
Hi everyone,
Intermediate & Advanced SEO | | romanbond
one of my sites has about 1000 'nofollow' links from the footer of another of my sites. Are these in any way hurtful? Any help appreciated..0 -
Link Building for E-Commerce
Hi, Our on page optimization, albeit for a few dupe content issues, is ok - We have good keyword rich URL's, Titles, H1's and unique product descriptions. So now I want to look at building links that will boost our DA and PA's. We have over 2000 products on the store and around 130 categories/subcategories -and I would appreciate any views on where to start - My initial view is to get backlinks from the relevant manufacturer websites to the "shop by brand" page on our site related to these manufacturers - What other strategies should I look at? Thanks, Ben
Intermediate & Advanced SEO | | bjs20100 -
Does Google WMT download links button give me all the links they count
Hi Different people are telling me different things I think if I download "all links" using the button in WMT to excel, I am seeing all the links Google is 'counting' when evaluating my site. is that right?
Intermediate & Advanced SEO | | usedcarexpert0 -
Link Age as SEO factor?
Hi Guys
Intermediate & Advanced SEO | | VividLime
I have a client who ranks well within a competitive sector of the travel industry. They are planning CMS move which will involve changing from .cfm to .aspx We will be doing the standard redirects etc However Matt's statement here on 301 redirects got me thinking
http://www.youtube.com/watch?v=zW5UL3lzBOA&t=0m24s He says that basically you loose a bit of page rank when you do a 301 redirect. Now, we will be potentially redirecting 1000s of links and my thinking is 'a lot of a little, adds up to a lot' In other words, 1000s of redirects may have a big enough impact to loose some rankings in a very competitive and aggressive space. So recommended that we contact the sites who has the link highest value and ask them to manually change the links from cfm to aspx. This will then mean that there are no loss value as with a 301 redirect. -But now I have another dilemma which I'm unsure about. So the main question:
Is link age factor in rankings ? If I update any links, this will make said link new to Google, so if link age is a factor, would this also lessen the value passed initially?0 -
Google, Links and Javascript
So today I was taking a look at http://www.seomoz.org/top500 page and saw that the AddThis page is currently at the position 19. I think the main reason for that is because their plugin create, through javascript, linkbacks to their page where their share buttons reside. So any page with AddThis installed would easily have 4/5 linbacks to their site, creating that huge amount of linkbacks they have. Ok, that pretty much shows that Google doesn´t care if the link is created in the HTML (on the backend) or through Javascript (frontend). But heres the catch. If someones create a free plugin for wordpress/drupal or any other huge cms platform out there with a feature that linkbacks to the page of the creator of the plugin (thats pretty common, I know) but instead of inserting the link in the plugin source code they put it somewhere else, wich then is loaded with a javascript code (exactly how AddThis works). This would allow the owner of the plugin to change the link showed at anytime he wants. The main reason for that would be, dont know, an URL address update for his blog or businness or something. However that could easily be used to link to whatever tha hell the owner of the plugin wants to. What your thoughts about this, I think this could be easily classified as White or Black hat depending on what the owners do. However, would google think the same way about it?
Intermediate & Advanced SEO | | bemcapaz0 -
Linking to Authorities
Hello, I know that if its good for the user, its not a bad move. But for this question I am specifically asking for how it affects my ranking. Does it help my ranking to link to appropriate authority sites?
Intermediate & Advanced SEO | | tylerfraser
Have you done any tests to see if linking out to authoritative sites like .gov info pages, industry leaders, etc. help with a sites ranking. I am thinking about taking of all of these outgoing links and just link to my important pages. Thank you, Tyler0