Webmaster Tools Indexed pages vs. Sitemap?
-
Looking at Google Webmaster Tools and I'm noticing a few things, most sites I look at the number of indexed pages in the sitemaps report is usually less than 100% (i.e. something like 122 indexed out of 134 submitted or something) and the number of indexed pages in the indexed status report is usually higher. So for example, one site says over 1000 pages indexed in the indexed status report but the sitemap says something like 122 indexed.
My question: Is the sitemap report always a subset of the URLs submitted in the sitemap? Will the number of pages indexed there always be lower than or equal to the URLs referenced in the sitemap?
Also, if there is a big disparity between the sitemap submitted URLs and the indexed URLs (like 10x) is that concerning to anyone else?
-
Unfortunately not, the closest you'll get is selecting a long period of time in Analytics and then exporting all the pages that received organic search traffic. If you could then cross check them with your list of URLs on your site it could provide you with a small list. But I would still check them in Google to make sure they aren't indexed. As I said it's not the best way.
-
Is there a reliable way to determine which pages have not been indexed?
-
Great answer by Tom already, but I want to add that probably images and other types of content whom are mostly not by default included in sitemaps could also be among the indexed 'pages'.
-
There's no golden rule that your sitemap > indexed pages or vice versa.
If you have more URLs in your sitemap than you have indexed pages, you want to look at the pages not indexed to see why that is the case. It could be that those pages have duplicate and/or thin content, and so Google is ignoring them. A canonical tag might be instructing Google to ignore them. Or the pages might be off the site navigation and are more than 4 links/jumps away from the homepage or another page on the site, make them hard to find.
Conversely, if you had lots more pages indexed than in your sitemap, it could be a navigation or URL duplication problem. Check to see if any of the pages are duplicate versions caused by things like dynamic URLs generated through search on the site or the site navigation, for example. If those pages are the only physical pages that you have created and you know every single one has been submitted in a sitemap - and so any other indexed URLs would be unaccounted for, that may well be cause for concern, so check nothing is being indexed multiple times.
Just a couple of scenarios, but I hope it helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Webmaster Tools equivalent to Change Default Address found in Analytics
Hello all! We're changing from http to https. In Google Analytics there is an option to change the default address so we keep our historical data. I can't find a similar option in Webmaster Tools though. Do you have to setup a new property or is there an option to change your current one? Thanks in advance!
Reporting & Analytics | | thegrbteam0 -
Google webmaster links vs Moz Reporte do follow links
A bit confused about my seo reports for a site I am tracking in Moz. Google webmaster reports i have 1836 links to my domain.
Reporting & Analytics | | KenW
Moz reports 273 external followed links.
Website Auditor reports 449 dofollow and 338 no follow.> total 787
What is important factor that I should be reporting to my client that really matters?0 -
Google Webmaster Preferred Domain Settings Help
I was recently running my SEO Moz report for my domain and saw a drastic drop in page rankings on the report. After some trouble shooting, I checked my Google Webmaster Tools and saw the "Preferred Domain for my Site has changed" the last week in which I saw the drastic drop. Under the "preferred domain" area, I have it set to www.marware.com but on most of the links to my site, it reads www.marware.com/ . We also have http://marware.com , but am not sure if this carries any relevance as the preferred domain is set for www.marware.com . Does the "/" make a difference in the "Preferred Domain" section? If so, how do I update it? Is there a way to confirm it is set up correctly? In the photo attached, what does "Linked Property" "Analytics Web Property" and "Associated Webmaster Tools Site" mean? Thanks in advance! T5tSCxm
Reporting & Analytics | | Khadaran0 -
Link being indexed
So I found this link to my website on the huffington post http://www.huffingtonpost.com/2012/11/13/california-car-insurance-rates-vary-study_n_2122614.html it's at the bottom in the "around the web" section. My question is this article has been around for almost 4 months yet the link does not show up in WMT. I would like to know if the link to http://www.shiftins.com is indexed and passing authority. Thank you.
Reporting & Analytics | | jameswalkerson0 -
Page Rank - logarithmic or exponential
Possibly a really stupid question. Is Page Rank logarithmic or exponential? I've seen a lot of people talking about Page Rank saying it's logarithmic but when they describe it they're actually talking about an exponential scale. (Apologies if I'm showing a basic misunderstanding in mathematical knowledge - I studied Drama)
Reporting & Analytics | | BenFox0 -
Will Bing/Google's engine index a page that has only been on social media?
Will Bing's engine index and rank a page that has only been seen on social media and has no inbound links? Will Google's? Are inbound links absolutely required to get a page indexed and ranking and getting traffic? If unknown, how would you go about testing this?
Reporting & Analytics | | SarahGoliger0 -
Yahoo Webmaster Tools still work?
Now that Yahoo is using Bing's search results, do we still need to monitor and use Yahoo's Webmaster's Tools - or do we stick to using the Bing Webmaster Tools?
Reporting & Analytics | | findachristianjob0 -
GA custom reports involving pages and goals - what are the metrics saying?
Hi, All! I would like to create a custom report that will enable me to see which of my pages are contributing to goal completion on my site (so I can then optimize the pages that are contributing the most, with maximal ROI for the optimization investment). If I make the dimension "page/page title" and the metric "goal X completions" - which would make sense - what exactly are the numbers that I am seeing telling me? Is it how many times a person started the goal funnel from that pages (meaning every goal would appear only once and there be no overlap)? That doesn't appear to be the case with the numbers, because the headline in the main "Goals" section tells me I have 30 goal completions for that goal, for example, but the headline in the custom report (which is adding up all the numbers) is, say, 100. Or does it mean the number of times that this page was ever in the navigation path of someone who ended up completing a goal? Then the same goal would be counted multiple times, for each page in the path. Additionally, I see this strange thing on some of my reports where the actual funnel pages appear as contributing towards goals, which I guess makes sense, but again the numbers don't match up. If the goal was to get to page B, and the funnel was A->B, and there were supposedly 30 goal completions, my custom report says that A gave 28 goal completions and B gave 25. Anyone know for sure - or through testing - what the case is with all these things? Any explanations will be much appreciated!
Reporting & Analytics | | debi_zyx0