Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

How to find out which URLs are NOT indexed on a site

Reporting & Analytics

2695

GregWalt Subscriber last edited by

Is there a way to easily find out which URLs on a store-type site are NOT being indexed in Google? For example, if my sitemap information in Google Webmaster tools shows I have 7342 URLs in my sitemap and 5699 of those indexed, how do I find out what the 1643 non-indexed URLS are?

Thanks for any help!
1 Reply Last reply
Reply Quote 0
SamAllen Subscriber last edited by

Web CEO has an indexed pages checker:

http://www.websiteceo.com/screenshots/checker/02.htm
1 Reply Last reply
Reply Quote 0
GrouchyKids last edited by

You should probably read this: http://searchengineland.com/do-links-from-expired-domains-count-with-google-17811
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Question on structuring URLs in a Drupal CMS - Adverse SEO or Analytics impacts?

Hello Moz Community, We're building out a health system (think a bunch of hospitals and clinics etc.) website on Drupal for the first time. Nebraskamed.com is our domain. Because we're using nodes instead of pages, our URL structure can pretty much be whatever we think makes sense. Our proposal is to drop /blog/ and related terms from the URL structure, because it doesn't really mean anything to the user. Instead, we'd use the service line "cancer" for example, followed by the name of the blog post or document. Example: nebraskamed.com/cancer/10-bone-cancer-myths Do you see any red flags (perhaps with SEO or Analytics for example) to what I'm proposing? domain name/service line/blog-post-name If so, do you have a URL structure you advise?
Reporting & Analytics | | Patrick_at_Nebraska_Medicine

1
Direct traffic coming to URLs with /rss_feedIP#

I'm doing a site audit for an organization that has a bunch of really messy old Drupal sites. In looking at their traffic, I see that a majority of it is coming to landing pages that look like this: http://clientsdomain.com/rss_feed173.8.208.97 plus other IP addresses. The bounce rate is 100% and time on site is less than a second. It looks like something that an RSS feed tool might use, but I've never seen something like it before. It creates its own landing page, hits the site, then appears to bounce. This is making their Analytics data look a whole lot worse than the site is actually doing, since the bounce rate is 100% on all that fake traffic. I have some experience with Drupal, but I've never seen anything like this in Drupal or any other CMS. Has anyone out there ever experienced something like this, where direct traffic comes to an rss feed landing page and bounces immediately?
Reporting & Analytics | | newwhy

0
Weird visitors to my site

Hi, I am in the process of disentangling myself from a dodgy SEO company. At some point they set up another GA account on my site without consulting me. I replaced the tracking code with my original account on my wordpress site, placing the tracking code on the dashboard. There is a box in the dashboard for you to do this. For some reason the account he created is still giving me analytics but from mostly one url :forum.topic55622342.darodar.com. It has marked it as a referral? When you click it it redirects to this site : http://activities.aliexpress.com/computers_channel.php?aff_platform=aaf&sk=vV3B2RJYB%3A&cpt=1421321021096&null There have been 218 visits from this "referral" in the last month and also 2 direct visits to a clients online gallery (i'm a photographer). I am guessing the code for this new account is still on the site somewhere? Funnily enough in the first month I was getting targeted by spam using my contact form and I was a bit perplexed as to why. We had to put captchas on the contact forms which I was loathe to do as its another step for a client to have to go through causing resistance. Has this link got something to do with it? I have recently disavowed a lot of toxic links he created, so maybe they had something to do with it? Best wishes. David.
Reporting & Analytics | | WallerD

0
Webmaster Tools Suddenly Asking For Verification of Site Registered for 5 Years

Google Webmaster Tools has been successfully installed on my website, (www.nyc-officespace-leader.com) for more than five years. Suddenly, today I have received a request to Verify this Site". This makes no sense. The only possibility I can think of is that this is somehow tied to the following events in the last month: 1. Launch of new version of website on June 4th
2. Installation of Google of Tag Manager
3. Sudden Increase in number of pages indexed by Google. Unexplained indexing of an additional 175 pages. About 625 pages should be indexed, while 800 are now indexed. In the last month ranking and traffic have fallen sharply. Could it be tat these issues are all linked? But the strangest issue is the request to verify the site. Does anyone have any ideas? Thanks,
Alan
Reporting & Analytics | | Kingalan1

0
Custom URL tracking for paid online ads

Hello! Our marketing team is testing paid online ad networks (banner ads, mobile ads and video ads) this year in addition to some traditional television advertising. We would like to track how effective these various ads are, and I'm wondering the best method to do so. In all cases, we're not setting up new pages for these ads to go to. They will simply go to an existing page on our site. For tracking purposes, here's what I'm wondering... If we set up custom URLs on our site (e.g. www.example.com/sports) then have the visitor immediately redirected to the intended page on our site (typically our home page), will Google Analytics show that custom URL in any report to see how much traffic flowed through it? Or will it not register because a page doesn't really exist for that URL? The biggest issue is with the banner ad network, which targets around ten categories of sites (sports, moms, entertainment, etc.). I know I'll be able to find the network listed as a referrer to see the total traffic the network sent us, but we would like to know specifically which category drove the visits. As such, would a custom URL for each category work, or will Google Analytics not pick it up because it's not hitting an actual page? For television ads, we are showing our URL as www.example.com/tv, which would then redirect to the intended landing page. In this case, it's a little more challenging because I won't have the referrer traffic to go by. But same problem... will GA recognize that URL and show it in Behavior > Site Content > All Pages? I hope this makes sense. If not please let me know and I'll try to explain. Thanks in advance,
Erik
Reporting & Analytics | | SmileMoreSEO

0
Where to find "Keywords that Sent Organic Search Visits" in Google Analytics?

Hi everyone, Tried searching for this answer but couldn't find it. In the new analytics, I can see that there is a graph that shows the number of unique keywords that brought traffic to our site sorted by weeks. I can't seem to find this data in Google Analytics. I can only find the number of visits but not sorted by how many keywords, instead it is just # of visits from all of the keywords. Thanks in advance. SZ
Reporting & Analytics | | swzhai

0
Duplicate content? Split URLs? I don't know what to call this but it's seriously messing up my Google Analytics reports

Hi Friends, This issue is crimping my analytics efforts and I really need some help. I just don't trust the analytics data at this point. I don't know if my problem should be called duplicate content or what, but the SEOmoz crawler shows the following URLS (below) on my nonprofit's website. These are all versions of our main landing pages, and all google analytics data is getting split between them. For instance, I'll get stats for the /camp page and different stats for the /camp/ page. In order to make my report I need to consolidate the 2 sets of stats and re-do all the calculations. My CMS is looking into the issue and has supposedly set up redirects to the pages w/out the trailing slash, but they said that setting up the "ref canonical" is not relevant to our situation. If anyone has insights or suggestions I would be grateful to hear them. I'm at my wit's end (and it was a short journey from my wit's beginning ...) Thanks. URL www.enf.org/camp www.enf.org/camp/ www.enf.org/foundation www.enf.org/foundation/ www.enf.org/Garden www.enf.org/garden www.enf.org/Hante_Adventures www.enf.org/hante_adventures www.enf.org/hante_adventures/ www.enf.org/oases www.enf.org/oases/ www.enf.org/outdoor_academy www.enf.org/outdoor_academy/
Reporting & Analytics | | DMoff

0
Unable to use Open Site Explorer

I have repeatedly tried to use Open Site Explorer on a site. I always get the same response: No Data Available for this URL The site is 4 months old. It is listed by Alexa in 1.3 million page category. The site ranks well on numerous key terms for the industry it covers. OSE offers 4 reasons for not having data: 1. Recency of page creation. In the explanation offered 45-60 days is the longest estimate it should take. The site has been live close to 120 days. 2. Deep down in the web. The tool doesn't even have any data for the site's home page. 3. Blocked pages. The site is listed in Google and these pages are not blocked. 4. No links. There are plenty of links. Site url is www.terapvp.com What can I do to fix this issue and get data?
Reporting & Analytics | | RyanKent

0