Webmaster Tools Indexed pages vs. Sitemap?
-
Looking at Google Webmaster Tools and I'm noticing a few things, most sites I look at the number of indexed pages in the sitemaps report is usually less than 100% (i.e. something like 122 indexed out of 134 submitted or something) and the number of indexed pages in the indexed status report is usually higher. So for example, one site says over 1000 pages indexed in the indexed status report but the sitemap says something like 122 indexed.
My question: Is the sitemap report always a subset of the URLs submitted in the sitemap? Will the number of pages indexed there always be lower than or equal to the URLs referenced in the sitemap?
Also, if there is a big disparity between the sitemap submitted URLs and the indexed URLs (like 10x) is that concerning to anyone else?
-
Unfortunately not, the closest you'll get is selecting a long period of time in Analytics and then exporting all the pages that received organic search traffic. If you could then cross check them with your list of URLs on your site it could provide you with a small list. But I would still check them in Google to make sure they aren't indexed. As I said it's not the best way.
-
Is there a reliable way to determine which pages have not been indexed?
-
Great answer by Tom already, but I want to add that probably images and other types of content whom are mostly not by default included in sitemaps could also be among the indexed 'pages'.
-
There's no golden rule that your sitemap > indexed pages or vice versa.
If you have more URLs in your sitemap than you have indexed pages, you want to look at the pages not indexed to see why that is the case. It could be that those pages have duplicate and/or thin content, and so Google is ignoring them. A canonical tag might be instructing Google to ignore them. Or the pages might be off the site navigation and are more than 4 links/jumps away from the homepage or another page on the site, make them hard to find.
Conversely, if you had lots more pages indexed than in your sitemap, it could be a navigation or URL duplication problem. Check to see if any of the pages are duplicate versions caused by things like dynamic URLs generated through search on the site or the site navigation, for example. If those pages are the only physical pages that you have created and you know every single one has been submitted in a sitemap - and so any other indexed URLs would be unaccounted for, that may well be cause for concern, so check nothing is being indexed multiple times.
Just a couple of scenarios, but I hope it helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Vanity URL vs domain URL
Hi guys, Our CEO is having an interview with a known broadcaster on radio. During the interview he will mention a specific URL www.example.com/marketingcampaign that we want track on Google Analytics, therefore behaving like a vanity URL redirecting to the actual URL www.example.com/resources/primary-keyword-2018. Would this work the same way a vanity URL in terms of tracking or not such as following guideline here ? I am asking because vanity URLs are supposed to be completely different domain name that gets purchased and in our case it is the same domain name just with a different URI. thanks guys!
Reporting & Analytics | | Taysir0 -
Subdomain vs Domain
I have a single product website running in a one page layout
Reporting & Analytics | | Roman-Delcarmen
my web have some internal pages such as, terms and conditions, policies and so on.
But in order to get a better ranking I decided to create a blog in the website, but my IT team told me that we can do it but in a subdomain.
The main domain use cakephp with a configuration oriented to security ( we had bad experiences with normal cms or ecommerces) So the structure of the website will this one www.mystore.com for the ecommerce blog.mystore.com for the blog So my questions are:
How is going to affect my seo?
Is there any difference betwen mystore/blog.com vs blog.mystore.com?
Wich is the best option for Google Analitycs / Search Console a single property or 2 properties? If you know some post or tutorial related with my question will be appreciated Thanks Guys1 -
WMT data vs. Analytics
Hi Each month I export my data from WMT and go through analytics. I also export our non brand queries from analytics and not WMT - I haven't had an issue before, but this month the impression data is quite different. In the hundreds of thousands different for keywords, everything seems to have taken a big jump and it seems strange. However, not everything is different, I've spot checked some and its; consistent in both, I'm not sure what's going on? One example would be: <colgroup><col width="281"> <col width="72"></colgroup>
Reporting & Analytics | | BeckyKey
| industrial shelving | 1016 |
| industrial racking | 999 | These appear as impressions from Query data in analytics, but they appear nowhere in my WMT query data. Analytics query data shows: | industrial equipment | 670 | WMT Data: | industrial equipment | 143 | Anyone have any idea? Perhaps some kind of tracking issue? Also I've triple checked dates etc...0 -
If you include video in a video sitemap should it also be in your global xml sitemap
I was wondering in hope of not duplicating URLs, if you include video in a video sitemap should it also be in your global xml sitemap. Would it be better to put them in one or both?
Reporting & Analytics | | mattdinbrooklyn0 -
Webmaster Tools vs. Google Trends data doesn't add up
I am investigating a two-month 25% drop in organic traffic from Google to a client's site. When I turned to the Webmaster Tools data for the site, there is a clear, gradual drop over the course of a couple months both in impressions and clicks. In general, the drop occurred across many pages and for a large number of queries; there wasn't a core group of keywords or pages that saw the drop...it was more sitewide. Yet, the average rankings reported by WMT were, for the top 100 or so landing pages, not significantly different. The site hosts information about medical conditions, and I wouldn't expect any time-related variations in search volume, and this was confirmed by looking at Google Trends data for a number of the top keywords. I started to look at the data by query for all the top keywords (all ranked in the top 10), and saw the following general trend: impressions were down, rankings stayed in the top 10, and Google Trends showed either flat or rising volumes. So I am trying to make sense of that. If the search volume trend did not decline and rankings held inside the top 10, then how could the number of impressions drop significantly? Am I trusting the WMT data too much? But the reality is that the volume of traffic measured by Google Analytics from Google organic did indeed drop the way Webmaster Tools show it.
Reporting & Analytics | | WillW0 -
Hi, my website suddenly fell to the sixth page. All of the keywords. Is this sandbox?
www.enakliyat.com.tr this is my website when, i write the google "enakliyat" i found my website in te sixth page. Two days ago my website was on the first in google. Do not understand what it is.
Reporting & Analytics | | iskq0 -
Google Webmaster Dropped Traffic
Hi Guys, I've recently implemented a new site design with a new url architecture etc.. I set up Google Webmaster tools in early March and went live with the new site on 2nd April. Since the 6th April (4 days after going live) I've notice a drop in impressions from 15,000 - 28,000 per day to 3,500 - 5,500 per day. Now I'm kind of new to this, so after I cleaned up after my initial panic, I checked impressions vs. clicks. Impression are down 44% and clicks 31%. Not bad I thought but then again what if I dropped so far off the radar I never made an impression. 1. So first question: Are the number of impressions of a keyword independant of ranking. So if I rank #3,445,234th will I still see impressions listed but avg. position reflect #3,445,234? So while I was thinking of asking these questions I checked Google Analytics for which I have just over 3 years of metrics. Compared to the past; overall traffic and organic traffic are the same if not 10-20% better. 2. So second: Am I missing something? Its a resort website so easter just ended and you would expect the traffic to match and drop, but such a sudden and dramitic drop in Webmaster Tools impressions does not match Google Analytics. Infact Organic traffic climbed slightly. Can anyone offer any insight? Thanks, Adam
Reporting & Analytics | | NaescentAdam0 -
Rel=nofollow link to a NoFollow, NoIndex Page?
I have a multitude of "schedule a demo" pages/forms on my site that are all identical, so I have on all of them. My question is, should I also place on the link to the "schedule a demo" pages? I know the generic rule is to never nofollow any internal links (per Matt Cutts http://www.youtube.com/watch?v=bVOOB_Q0MZY), but should that still apply if the link directs to a page that is noindex, nofollow? Thanks for your input in advance; don't want to run into, as Matt Cutts puts it, "a mini kerfuffle!"
Reporting & Analytics | | BethA0