Should I include unnecessary pages in the sitemap.xml
-
I have a lot of pages that I don't want Google to index, so for most of them, I used cannonical, were they were duplicates, noindex were I wanted to remove the pages, but the question is: Should I include these pages in the sitemap.xml, or just the important pages?
Also should I include them in order to get the changes indexed fastet by Google?
-
That clearly changes my ideas about this ;-). As we're talking about a couple of million pages I wouldn't include them in the sitemaps then and to make sure they're absolutely made sure that it's noindexed.
-
One of the main problem is that there are a lot of such pages (aprox. 2-3 milions) and my indexation rate is really slow for a site this big. The old sitemap structure was to complex, and I wanted so simplify it, so Google wiil crawl only the important pages
-
Hi Silviu,
Hard question, related to your use case I would suggest not to include them. But on the other hand it also shouldn't harm your performance as the URLs in a sitemap are mostly meant to search engines as a full list of URLs they might miss otherwise. It would also help you to see what your indexation rate is. Curious to see what other people think about this.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why are http and https pages showing different domain/page authorities?
My website www.aquatell.com was recently moved to the Shopify platform. We chose to use the http domain, because we didn't want to change too much, too quickly by moving to https. Only our shopping cart is using https protocol. We noticed however, that https versions of our non-cart pages were being indexed, so we created canonical tags to point the https version of a page to the http version. What's got me puzzled though, is when I use open site explorer to look at domain/page authority values, I get different scores for the http vs. https version. And the https version is always better. Example: http://www.aquatell.com DA = 21 and https://www.aquatell.com DA = 27. Can somebody please help me make sense of this? Thanks,
On-Page Optimization | | Aquatell1 -
Each page with a different meta description?
each page on my website represents a different department, can I program the header to show a different meta description on each page or should there only be 1 meta description tag per domain?
On-Page Optimization | | RonnieT0 -
Wordpress Post as Slideshow - One long page vs many short pages?
We are working on implementing a slideshow format for some of the posts on a website, and it appears that using this format breaks a long post into several shorter pages. That's what we want from a user experience standpoint, but are wondering if there are negative SEO implications from having the content broken up in this way, and whether search engines will view it as one longer page or several very short pages? Here is an example: http://www.forthebestrate.com/10-cheap-ideas-for-summer-fun/ Thanks for the help!
On-Page Optimization | | ILM_Marketing0 -
Meta Title for Category Pages
I am trying to improve the SEO for a few key category pages on my blog. I have two ranking really well so I want to boost them and bring up some others. Can I put two keywords in the meta title? Example: Maternity Deals | Pregnancy Deals Or should I just stick with one? Thanks!
On-Page Optimization | | dealblogger0 -
Tool to creat a good XML sitemap
Hello lads, I need to creat a XML sitemap for a website so I can add to Google Webmaster and Bing Webmaster. What do you guys recommend? Tks in advance! PP
On-Page Optimization | | PedroM0 -
How to get rid of those duplicate pages
Hi eveyone Just got my first diagnostics report and i got 220 duplicate page titles and 217 duplicate content pages. I know why this has happened it is because i did play about a bit and did originally have:- www.mydomainname.com/index.php/alpha Then i change the page path to:- www.mydomainname.com/alpha Then i change the page path to:- www.mydomainname.com/category/alpha So now when i get crawled i have 3x duplicate page titles, descriptions and page content. Even when i have put 301 redirects to my preferred domain path. Which is hurting my seo, right? How do i stop theold domains from giving me these bad reports? The site is on Joomla Thanks guys Oujipickle
On-Page Optimization | | oujipickle0 -
Why is this page ranking highest?
I've just used Open Site Explorer to compare some sites whose (unpaid) Google ranking I aspire to. They all have higher authority than my site, but the top ranking site out of the 3 I've looked at has the lowest Page Authority, hardly and links (when the others have hundreds), lowest page rank and lowest page trust. In fact, when you look at the top ranking page (ranks #1), it does not even have the search term in it as a complete phrase. One thing I do notice is that it does have 100,000s of linking root domains from one linking root domain. So how can it rank number one on Google?
On-Page Optimization | | Beemer0