Sitemap - What are the recommendations on the number of links
-
Hi,
I have a sitemap(s) which is very large(.i.e. 60000) links, is it recommended to have so many links and how come when I do a site search(site:mydomain) the number of links are less than on my site map?
-
Sitemaps cannot (should not) contain more than 50,000 URLs: https://www.sitemaps.org/faq.html#faq_sitemap_size
I'd recommend you instead create a sitemap index to house multiple sitemap files. Keep in mind you will need to separate the URLs in them in order to represent all 60K URLs you have in your existing sitemap.
Separately, EGOL makes excellent points: sitemaps aren't the only way to get pages indexed. It's entirely possible that you do not have sufficient internal links that aid crawlers' discovery of your content: https://moz.com/learn/seo/internal-link
You may also have directives (e.g. noindex) on certain pages or in your robots.txt that prevents crawlers from crawling and indexing certain parts of your site. It may be time for a technical audit: https://www.distilled.net/technical-seo-audit-checklist/
-
how come when I do a site search(site:mydomain) the number of links are less than on my site map?
There are many causes of poor indexing....
-- if your site does not have very many links, it is possible that Google does not crawl it deeply and completely, and might even forget many of your pages between crawls
-- poor indexing can be caused by a poor site structure, where you have category pages that link to subcategory pages which link to deep pages.... AND, you have lots of internal and external links hitting these category pages to force crawlers deep into your site - where they must chew their way out through a lot of pages
-- also, consider your content... is it unique, substantive, not copy-pasted from other websites... with such problems, Google can choose to ignore your pages
is it recommended to have so many links
That is a lot of links. I would consider two site maps, each with half of our pages, that will get more crawling deep into your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Link Juice
Do you guys think having a guest post close to the root domain has more link juice that being in subfolders? example.com/123 vs example.com/nov/123 Both pages have the same amount of internal links and both pages don't have external links
Intermediate & Advanced SEO | | arango201 -
Are These Links Junk?
I hired an SEO to create incoming links to me website insisting that only white hat techniques be used. The SEO was highly recommended by a family friend. In 3 months about 14 links to my site were obtained. The URLs for the domains where the links originate are below. I paid $8,000 for the services of the SEO provider to create the links over 4 months. When I looked at the links more carefully I noticed that the sites did not seem to have owners. That there was no phone number, physical address and scant information about ownership. I also noticed that most pages had outgoing links of a promotional nature. Also, that content created for me had grammatical and occasional spelling errors. The links did not look bad in terms of MOZ domain authority and MOZ page authority, but when I went subscribed to AHREFS a few days ago and evaluated the links, I noticed that the URL rating (somewhat equivalent to MOZ page authority) was really low. Furthermore, noticed that one of the domains solicits paid links from gambling sites. The SEO who sourced the links on my behalf says he will explain why I "have nothing to worry about". Dividing his monthly fee by the number of links and I paid $571 per link. Is it possible the the below domains could have pages that I would want links from? Would these links be potentially worth more than a few hundred dollars? O are these sites more like a cheap PBN or maybe "the hoth". If the links are in fact good I would be delighted. But if they are of poor quality could I legitimately ask for a refund? Also, are these domains so bad that it is imperative for me to get the links removed? <colgroup><col width="198"></colgroup>
Intermediate & Advanced SEO | | Kingalan1
| https://www.equities.com |
| http://www.realestaterama.com |
| https://moneyinc.com |
| https://homebusinessmag.com |
| http://digitalconnectmag.com |
| https://suburbanfinance.com/ |
| http://www.homebunch.com |
| http://inman.com |
| https://www.propertytalk.com/ |
| http://activerain.com |
| https://www.conservativedailynews.com/ |
| http://moneyforlunch.com/ |
| http://baltimorepostexaminer.com/ |
| https://www.tgdaily.com/ |
| |0 -
Reasonable to Ask URL of Link from SEO Providing New Links before Link Activation?
My firm has hired an SEO to create links to our site. We asked the SEO to provide a list of domains that they are targeting for potential links. The SEO did not agree to this request on the grounds that the list is their unique intellectual property. Alternatively I asked the SEO to provide the URL that will be linking to our site before the link is activated. The SEO did not agree to this. However, they did say we could provide comments afterwards so they could tweak their efforts when the next 4-5 links are obtained next month. The SEO is adamant that the links will not be spam. For whatever it is worth the SEO was highly recommended. I am an end user; the owner and operator of a commercial real estate site, not an SEO or marketing professional. Is this protectiveness over process and data typical of link building providers? I want to be fair with the provider and hope I will be working with them a long time, however I want to ensure I receive high quality links. Should I be concerned? Thanks,
Intermediate & Advanced SEO | | Kingalan1
Alan0 -
For a sitemap.html page, does the URL slug have to be /sitemap?
Also, do you have to have anchors in your sitemap.html? or are naked URLs that link okay?
Intermediate & Advanced SEO | | imjonny1230 -
Is a link inside a video player considered an inbound link from the domain the player is embedded in?
Good afternoon...We just added a link to our homepage inside the menu of our video player. In the link below, if you click on the menu icon in the bottom right corner of the video player, you'll see a "Powered by WellcomeMat" link at the bottom of the menu. http://www.wellcomemat.com/video/kt216e25172416n/-Rancho-Santa-Fe/Ca/92067/16596-Via-Lago-Azul/1234567890/ My question for the community is would that link be considered an inbound link from any site that has the video player embedded? So hypothetically, the video player is embedded into www.abcd.com. If a user would click on that link and go to our homepage, would search engines recognize that as an inbound link from abcd.com, even though it sits within our video player? And most of the time, the player sits within an iframe. So that's why I'm not 100% sure. Thanks for reading and for your help! It's much appreciated!!
Intermediate & Advanced SEO | | brian7201 -
Should I bother with a Video Sitemap?
Morning all, I've started a pretty aggressive Video content push in recent weeks. All our videos are on our YouTube channel. I decided to go with hosting the videos on YouTube based on my research on moz.com, especially considering the potential reach of the content on YouTube. What I'm finding is that the YouTube channel is doing great. We've hit 200 subscribers and 15K views in a little under a month. Wayyyy more than I could have ever hoped for. But the blog posts on our website are getting minimal traffic and no search visibility. That doesn't necessarily bother me, since the intention of our marketing campaign is to use YouTube to drive traffic to our website. So I guess my question is really more to do with optimizing the site with Video Sitemaps and best practices for Google Webmaster Tools. Right now we have YouTube videos embedded on blog posts like this one that have a time-stamp. But I've been working to create Gallery-style pages (no time-stamp) which would have multiple YouTube videos embedded on them like this one. These make it easier for visitors to watch multiple videos without needing to skip around to multiple blog posts. The challenge I'm running into is that when I go to submit a Video Sitemap to GWT I get an error saying that I have duplicate page content within the video sitemap. I've used several WP plugins to do this. It seems that when there is a video embedded on multiple URLs (pages + posts) the plugins will ignore the posts and only add the pages to the video sitemap. Here is my regular Sitemap Here is my video Sitemap I've attached a screenshot of my current Yoast Video SEO config if that's useful for reference. Does anyone have experience with using multiple sitemaps in GWT? I'm starting to think that maybe I shouldn't even bother with a video sitemap. Maybe those gallery-style pages should just go in the regular sitemap? Any thoughts or advice would be highly appreciated! Thanks llQfydA
Intermediate & Advanced SEO | | TMHoward860 -
XML Sitemaps - how to create the perfect XML Sitemap
Hello, We have a site that is not updated very often - currently we have a script running to create/update the XML sitemap every time a page is added/edited or deleted. I have a few questions about best practices for creating XML sitemaps. 1. If the site is not updated for months on end - is it a bad idea to force the script to update i.e. changing the dates once a month? Will google noticed nothing has changed just the date i.e. all the content on the site is exactly the same. Will they start penalising you for updating an XML sitemap when there is nothing new about the website?
Intermediate & Advanced SEO | | JohnW-UK
2. Is it worth automating the XML file to link into Bing/Google to update via webmaster tools - as I say even if the site is never updated?
3. Is the use of "priorities" necessary?
4. The changefreq - does that mean Google/Bing expects to see a new file ever month?
5. The ordering of the pages - the script seems pretty random and put the pages in a random order - should we make it order the pages with the most important ones first? Should the home page always be first?
6. Below is a sample of how our XML sitemap appears - is there anything that we should change? i.e. all marked up properly? This XML file does not appear to have any style information associated with it. The document tree is shown below.
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"><url><loc>http://www.domain.com</loc>
<lastmod>2013-11-06</lastmod>
<changefreq>monthly</changefreq></url>
<url><loc>http://www.domain.com/contact/</loc>
<lastmod>2013-11-06</lastmod>
<changefreq>monthly</changefreq></url>
<url><loc>http://www.domain.com/sitemap/</loc>
<lastmod>2013-11-06</lastmod>
<changefreq>monthly</changefreq></url></urlset> Hope someone can help enlighten us to best practices0 -
.GOV Link - same impact on my site's rankings whether link to home or Gov related category?
I own a job site and I am about to get a link from a .GOV. My site has a category called "State Jobs". Should I ask the ".Gov" to link to my homepage or to the state job page and use the anchor text "State Jobs". I understand "State Jobs" page would get a big kick by that being the anchor text and linking to that specific page, but the question I have is this: for my site as a whole (homepage and various categories) would they get around the same "push up" whether the linking is to 1) my homepage with anchor text being my site's name or 2) to the state job specific page and in this case the anchor text would be "State Jobs"? thank you
Intermediate & Advanced SEO | | knielsen0