This might be a silly question...
-
I have 14,000 pages on my website, but when I do a site:domain.com search on google, it shows around 55,000.
I first thought.."hmm, maybe it is including subdomains". So I tried site:www.domain.com and now it shows 35,000. That still is more than double the pages I have.
Any ideas why? When you filter a google search using "site", isn't it meant to pick up just that site's pages?
*P.S I tried using the SEOquake add-on to download search results as a CSV file to review, but the add-on only downloads the first 100 search results
-
Thanks, I'll look at manually specifying these parameters and see if they make an impact.
-
Thank you streamline,
That's interesting, I have provided 'searchType', 'searchTerm', 'search', 'cat', 'filter2name', 'filter1name' as URL Parameters
- Are URL Parameters case sensitive?
- Should these be not set as CRAWL - 'Let Googlebot decide' and instead manually given as best practise? It looks like Google is still indexing from what you guys have found.
-
Easy way to be sure is to do a quick search on Google to see if they are ranking. If you know for sure the Parameters make no difference its usually better to specifically signal that through the WMT console. While Google tend to be pretty smart at these kind of things they can always make mistakes so may as well give as much info as possible.
-
Hi there,
I am doing a crawl on the site listed in your profile (www.abdserotec.com) using Screaming Frog SEO Spider using Googlebot as the User Agent, and I am seeing many more URLs than the 14,000 pages you have. The bulk majority of these excess pages are the Search Results pages (such as http://www.abdserotec.com/search.html?searchType=BASIC&searchTerm=STEM CELL FACTOR&cat=&Filter2Name=GO&Filter2Value=germ-cell development&filterCount=2&type=&filter1name=Spec&filter1value=STEM CELL FACTOR). While these URLs are not showing up in the Google Index when you try searching your site with the site: command, Google is still definitely accessing them and crawling them. As Tuzzell just suggested, I also highly recommend configuring the parameters within GWT.
-
We have 49 Parameters listed and given 'Let Googlebot decide'. I thought adding the parameters here would avoid google from indexing those URLs? I believe our setup already does this?
-
What do you mean by "multiple ways"? We have a search page which isn't indexed and internal links from pages but that wouldn't count would it? It's not like the URL string changes from a search page or internal hyperlink?
-
Have you discounted URL parameters through Google Webmaster tools? This would be particularly prevalent for an ecommerce site as if you have not Google could be looking at /page, /page?p=x, /page?p=y etc and counting these as unique pages. This creates obvious dupe content issues and is easily fixed in WMT by going to:
Crawl>URL Parameters
Hope that helps.
-
what about multiple ways of getting to the same product?
-
There are no blog posts, it's an ecommerce site and every product page and article page has the URL www.domain.com/.
I even looked at my GA and it reports 14,000 pages
If there was a tool to export all the search results, I could've manually looked into why the big count.
-
Hi Cyto,
Does that include your blog pages? If you have a blog, such as Wordpress, then it may be picking up the different URL's that each post may have. So for example, you might have the blog post in different categories which would mean the post is accessible from 2 different URL's
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mobile Brand Markup Question
Hi Moz Community, I was searching for "Gifts for men" in Google Search on my phone and saw a few results in the 3rd (Nordstrom), 4th (Etsy) and 5th(Grommet) place that had their brand name in the area under the title tag where the green url is usually listed on desktop. One example of the green text under the title tag is Nordstrom which lookes like this: Nordstrom > Shop > Gifts Whereas the first result from UncommonGoods looks like this in the green text: www.uncommongoods.com > by recipient I'm trying to figure out what markup Nordstrom, Etsy, ect used on their site to get their brand name to show up not as a url but as a brandname Anyone know the answer to this? Thanks!
Algorithm Updates | | znotes0 -
Puzzling Penalty Question - Need Expert Help
I'm turning to the Moz Community because we're completely stumped. I actually work at a digital agency, our specialism being SEO. We've dealt with Google penalties before and have always found it fairly easy to identify the source the problem when someone comes to us with a sudden keyword/traffic drop. I'll briefly outline what we've experienced: We took on a client looking for SEO a few months ago. They had an OK site, with a small but high quality and natural link profile, but very little organic visibility. The client is an IT consultancy based in London, so there's a lot of competition for their keywords. All technical issues on the site were addressed, pages were carefully keyword targeted (obviously not in a spammy way) and on-site content, such as services pages, which were quite thin, were enriched with more user focused content. Interesting, shareable content was starting to be created and some basic outreach work had started. Things were starting to pick up. The site started showing and growing for some very relevant keywords in Google, a good range and at different levels (mostly sitting around page 3-4) depending on competition. Local keywords, particularly, were doing well, with a good number sitting on page 1-2. The keywords were starting to deliver a gentle stream of relevant traffic and user behaviour on-site looked good. Then, as of the 28th September 2015, it all went wrong. Our client's site virtually dropped from existence as far as Google was concerned. They literally lost all of their keywords. Our client even dropped hundreds of places for their own brand name. They also lost all rankings for super low competition, non-business terms they were ranking for. So, there's the problem. The keywords have not shown any sign of recovery at all yet and we're, understandably, panicking. The worst thing is that we can't identify what has caused this catastrophic drop. It looks like a Google penalty, but there's nothing we can find that would cause it. There are no messages or warnings in GWT. The link profile is small but high quality. When we started the content was a bit on the thin side, but this doesn't really look like a Panda penalty, and seems far too severe. The site is technically sound. There is no duplicate content issues or plaigarised content. The site is being indexed fine. Moz gives the site a spam score of 1 (our of 11 (i think that's right)). The site is on an ok server, which hasn't been blacklisted or anything. We've tried everything we can to identify a problem. And that's where you guys come in. Any ideas? Anyone seen anything similar around the same time? Unfortunately, we can't share our clients' site's name/URL, but feel free to ask any questions you want and we'll do our best to provide info.
Algorithm Updates | | MRSWebSolutions0 -
Question regarding very unique SERP -
Hi guys, I have been brainstorming regarding a very unique SERP that i figured out while navigating search, the serp looks some thing like this http://postimg.org/image/phkol0d97/. i checked the site in structured testing tool but the only thing that i found is some PMR meta tags nothing except that. Can any one help me understand this and i would be more helpful if some one can guide me for the same. #peace
Algorithm Updates | | prashanth1230 -
Question About : Redirecting Old Pages to New & More Relevant Ones
I'm looking over a friends website, which used to have great natural ranking for some big keywords. Those ranking & CTR's have dropped a lot, so the next thing I checked into was top selling Brand & Category pages. Its seems like every year or so a New Page was constructed for each brand... Many of which have high quality and natural inbound links. However, the pages no longer have products and simply look outdated. I'm trying to figure out if they should place redirects on all the old pages to a new URL which is more seo friendly. Example Links : http://www.xyz.com/nike2004.html , http://www.xyz.com/nike-spring2006.html , http://www.xyz.com/2011-nike-shoes.html - (have quality inbound links, bad content) .... Basically would it be advantageous to place redirects on all of these example pages to a new one that will be more permanent... http://www.xyz.com/nike-shoes.html I'm also looking at about 15 brands and maybe 100+ old/outdated urls, so I wasn't sure if I should do this & to what extent. Considering many of the brand pages do rank, but not as well as they should... Any input would help, thanks
Algorithm Updates | | Southbay_Carnivorous_Plants0 -
International foreign language SEO questions
I'm looking to add some foreign language pages to a website and have a lot of international SEO questions. I think the overall question is can you do SEO yourself if you are a native English speaker for a language you don't speak (like Chinese)? 1. How do you go about doing keyword research for a foreign language? What tools are available? 2. How do you know what search engines you should optimize for in a different country? And where can you find the technical SEO requirements for each? I'm wondering things like title tag length for Baidu. Or is the Title length different for Yahoo Japan vs. US? Do you write titles and meta tags in Chinese/Japanese for respective countries? Etc.
Algorithm Updates | | IrvCo_Interactive0 -
Domain Name History Question
Hi, When launching a new domain, do you think Google holds these back in the rankings for a certain time period? I have noticed with a few, the rankings are held back for a few months (10 page deep results when the site's first indexed and ranked), then almost like a switch rankings start to come through pretty aggressively in some cases. For example: a result could be on page 16 for a month or so, then all of a sudden jump through to page 6 (with no link building or site update), at this point the result would stay steady and would need work to push through. Anyone else get this, or does anyone have any insight about domain history and Google. Cheers
Algorithm Updates | | activitysuper0 -
External Linking Best Practices Question
Is it frowned upon to use basic anchor text such as "click here" within a blog article when linking externally? I understand, ideally, you want to provide a descriptive anchor text, especially linking internally, but can it negatively affect your own website if you don't use a descriptive anchor text when linking externally?
Algorithm Updates | | RezStream80 -
Client question: What should I do?
I have a client who ranks #1 for all her branded keywords. Other than those keywords, she doesn't really have an objective with SEO other than to get her name out there. There are articles in some high end online magazines(think Forbes, Times, etc.) that mention her, and she wants those articles to show up when people do a branded keyword search for those magazines. She also wants those articles to show up when people Google her. Usually when I do SEO for a client, they have a site and they want that site to show up for a variety of targeted keywords. Has anyone run into people wanting to 1) SEO other sites to get them in the top 10 on their branded keywords and 2) get listed under other peoples branded keywords? Is this even possible? My gut says no but I feel obliged to look into it. Do I just build links to the articles with her keywords and hope for the best? I have no idea what to do with this client.
Algorithm Updates | | AdamMetrix0