This might be a silly question...

[Bio-RadAbs]

I have 14,000 pages on my website, but when I do a site:domain.com search on google, it shows around 55,000.

I first thought.."hmm, maybe it is including subdomains". So I tried site:www.domain.com and now it shows 35,000. That still is more than double the pages I have.

Any ideas why? When you filter a google search using "site", isn't it meant to pick up just that site's pages?

*P.S I tried using the SEOquake add-on to download search results as a CSV file to review,  but the add-on only downloads the first 100 search results

[Bio-RadAbs]

Thanks, I'll look at manually specifying these parameters and see if they make an impact.

[Bio-RadAbs]

Thank you streamline,

That's interesting, I have provided 'searchType', 'searchTerm', 'search', 'cat', 'filter2name', 'filter1name' as URL Parameters

• Are URL Parameters case sensitive?
• Should these be not set as CRAWL - 'Let Googlebot decide' and instead manually given as best practise? It looks like Google is still indexing from what you guys have found.

[Sarbs]

Easy way to be sure is to do a quick search on Google to see if they are ranking. If you know for sure the Parameters make no difference its usually better to specifically signal that through the WMT console. While Google tend to be pretty smart at these kind of things they can always make mistakes so may as well give as much info as possible.

[StreamlineMetrics]

Hi there,

I am doing a crawl on the site listed in your profile (www.abdserotec.com) using Screaming Frog SEO Spider using Googlebot as the User Agent, and I am seeing many more URLs than the 14,000 pages you have. The bulk majority of these excess pages are the Search Results pages (such as http://www.abdserotec.com/search.html?searchType=BASIC&searchTerm=STEM CELL FACTOR&cat=&Filter2Name=GO&Filter2Value=germ-cell development&filterCount=2&type=&filter1name=Spec&filter1value=STEM CELL FACTOR). While these URLs are not showing up in the Google Index when you try searching your site with the site: command, Google is still definitely accessing them and crawling them. As Tuzzell just suggested, I also highly recommend configuring the parameters within GWT.

[Bio-RadAbs]

We have 49 Parameters listed and given 'Let Googlebot decide'. I thought adding the parameters here would avoid google from indexing those URLs? I believe our setup already does this?

[Bio-RadAbs]

What do you mean by "multiple ways"? We have a search page which isn't indexed and internal links from pages but that wouldn't count would it? It's not like the URL string changes from a search page or internal hyperlink?

[Sarbs]

Have you discounted URL parameters through Google Webmaster tools? This would be particularly prevalent for an ecommerce site as if you have not Google could be looking at /page, /page?p=x, /page?p=y etc and counting these as unique pages. This creates obvious dupe content issues and is easily fixed in WMT by going to:

Crawl>URL Parameters

Hope that helps.

[KarlBantleman]

what about multiple ways of getting to the same product?

[Bio-RadAbs]

There are no blog posts, it's an ecommerce site and every product page and article page has the URL www.domain.com/.

I even looked at my GA and it reports 14,000 pages

If there was a tool to export all the search results, I could've manually looked into why the big count.

[KarlBantleman]

Hi Cyto,

Does that include your blog pages? If you have a blog, such as Wordpress, then it may be picking up the different URL's that each post may have. So for example, you might have the blog post in different categories which would mean the post is accessible from 2 different URL's