This might be a silly question...
-
I have 14,000 pages on my website, but when I do a site:domain.com search on google, it shows around 55,000.
I first thought.."hmm, maybe it is including subdomains". So I tried site:www.domain.com and now it shows 35,000. That still is more than double the pages I have.
Any ideas why? When you filter a google search using "site", isn't it meant to pick up just that site's pages?
*P.S I tried using the SEOquake add-on to download search results as a CSV file to review, but the add-on only downloads the first 100 search results
-
Thanks, I'll look at manually specifying these parameters and see if they make an impact.
-
Thank you streamline,
That's interesting, I have provided 'searchType', 'searchTerm', 'search', 'cat', 'filter2name', 'filter1name' as URL Parameters
- Are URL Parameters case sensitive?
- Should these be not set as CRAWL - 'Let Googlebot decide' and instead manually given as best practise? It looks like Google is still indexing from what you guys have found.
-
Easy way to be sure is to do a quick search on Google to see if they are ranking. If you know for sure the Parameters make no difference its usually better to specifically signal that through the WMT console. While Google tend to be pretty smart at these kind of things they can always make mistakes so may as well give as much info as possible.
-
Hi there,
I am doing a crawl on the site listed in your profile (www.abdserotec.com) using Screaming Frog SEO Spider using Googlebot as the User Agent, and I am seeing many more URLs than the 14,000 pages you have. The bulk majority of these excess pages are the Search Results pages (such as http://www.abdserotec.com/search.html?searchType=BASIC&searchTerm=STEM CELL FACTOR&cat=&Filter2Name=GO&Filter2Value=germ-cell development&filterCount=2&type=&filter1name=Spec&filter1value=STEM CELL FACTOR). While these URLs are not showing up in the Google Index when you try searching your site with the site: command, Google is still definitely accessing them and crawling them. As Tuzzell just suggested, I also highly recommend configuring the parameters within GWT.
-
We have 49 Parameters listed and given 'Let Googlebot decide'. I thought adding the parameters here would avoid google from indexing those URLs? I believe our setup already does this?
-
What do you mean by "multiple ways"? We have a search page which isn't indexed and internal links from pages but that wouldn't count would it? It's not like the URL string changes from a search page or internal hyperlink?
-
Have you discounted URL parameters through Google Webmaster tools? This would be particularly prevalent for an ecommerce site as if you have not Google could be looking at /page, /page?p=x, /page?p=y etc and counting these as unique pages. This creates obvious dupe content issues and is easily fixed in WMT by going to:
Crawl>URL Parameters
Hope that helps.
-
what about multiple ways of getting to the same product?
-
There are no blog posts, it's an ecommerce site and every product page and article page has the URL www.domain.com/.
I even looked at my GA and it reports 14,000 pages
If there was a tool to export all the search results, I could've manually looked into why the big count.
-
Hi Cyto,
Does that include your blog pages? If you have a blog, such as Wordpress, then it may be picking up the different URL's that each post may have. So for example, you might have the blog post in different categories which would mean the post is accessible from 2 different URL's
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Domain Migration Question
Lets say there is a brand that has one primary product type at different optional tiers. (Think something like SMB/Enterprise/Individual) Lets also say that 1 year ago this brand migrated from having everything under 1 domain (Domain A) to moving 2 of their product tiers to another domain (Domain B), a new domain. They have done some initial SEO work on this domain and had a pretty successful migration but it has also been decided that they are going to no longer offer one of these product tiers and they intend to eventually migrate everything back under the 1 domain (Domain A) They just are not sure whether they should do this now or later.
Algorithm Updates | | DRSearchEngOpt
During this next year or so there is also going to be some likely re-branding/design, etc...stemming from this decision, on the domain, meaning content changes and all that fun that goes into a migration/re-design/re-branding strategy. The timing of this has not been fully decided on. Here is the question: Should they a) Migrate back to Domain A first and then do the re-design or b) Keep 2 separate domains for now, figure out the re-design/re-branding, make content changes and then migrate Site A over in a year or so after all changes have been made? My concern with option a) is that they migrated a little less than 1 year ago and will be migrating back which I feel could have a negative impact on the content and the domain. The positive side I see here is that this impact could be just as large even if we waited so doing this now might be a better, more efficient use of our time if we can migrate and make content changes fairly close together or concurrently.
My concern with option b) is that the tier they no longer offer makes up the majority of that sites business and traffic, leaving us with not much in terms of content that ranks well and garners much traffic. Trying to optimize for the remaining product tier by itself on it's own domain could be quite hard and then having to migrate it in a year or so back to Domain A could negatively impact any small organic impact I can make on applicable pages/domain. Does anybody have any input here? I am leaning towards Option A and but wanted to get some other opinions. Thanks Everybody! Edit: So far, this has received a lot of views but no input. I am hoping to have a bit of a dialog on this so any ideas or input is welcome.0 -
International foreign language SEO questions
I'm looking to add some foreign language pages to a website and have a lot of international SEO questions. I think the overall question is can you do SEO yourself if you are a native English speaker for a language you don't speak (like Chinese)? 1. How do you go about doing keyword research for a foreign language? What tools are available? 2. How do you know what search engines you should optimize for in a different country? And where can you find the technical SEO requirements for each? I'm wondering things like title tag length for Baidu. Or is the Title length different for Yahoo Japan vs. US? Do you write titles and meta tags in Chinese/Japanese for respective countries? Etc.
Algorithm Updates | | IrvCo_Interactive0 -
A few sitemap questions
1. When I do a sitemap through a generator, it lists some of my URLs twice, with and without the last slash. Ex: <url><loc>http://www.howlatthemoon.com/locations/location-hollywood</loc><lastmod>2013-11-25T16:12:50+00:00</lastmod><changefreq>daily</changefreq><priority>0.9</priority></url> <url><loc>http://www.howlatthemoon.com/locations/location-hollywood/</loc><lastmod>2013-11-25T16:14:27+00:00</lastmod><changefreq>daily</changefreq><priority>0.69</priority></url> Should I remove one of these or leave it? 2. What is the importance of lastmod? I've read that if you have a lastmod listed, Google won't recrawl until a new time/date is up? 3. This goes along with lastmod, but is changefreq important? Can it hurt me at all?
Algorithm Updates | | howlusa0 -
SERP Question - Site showing up for national term over local term recently
Hey Moz, This has been happening to me with a couple of clients recently and I wanted to kick it out to the community and see if anyone else has experienced it and might be able to shed some light on why. (Disclaimer: Both clients are in the elective healthcare space)
Algorithm Updates | | Etna
Scenario: Client's site is optimized for a fairly competitive "procedural keyword + location" phrase. Historically, the site had been ranking on the first page for a while until it suddenly dropped off for that query. At the same time, the page now ranks on the first page for just the procedural term, without the location modifier (obviously much more competitive than with the location modifier). Searches on Google were set to the city in which the client was located. Not that I'm complaining, but this seems a little weird to me. Anyone have a similar situation? If so, any theories about what might have caused it? TL;DR - Site ranked on 1st page for "keyword + location modifier" historically, now ranking on 1st page for "keyword" only and not found with "keyword + location modifier" TRQd9Hu0 -
VRL Parameters Question - Exclude? or use a Canonical Tag?
I'm trying to figure something out, as I just finished my "new look" to an old website. It uses a custom built shopping cart, and the system worked pretty well until about a year when ranking went down. My primary traffic used to come from top level Brand pages. Each brand gets sorted by the shopping cart and a Parameter extension is added... So customers can click Page 1 , Page 2 , Page 3 etc. So for example : http://www.xyz.com/brand.html , http://www.xyz.com/brand.html?page=1 , http://www.xyz.com/brand.html?page=2 and so on... The page= is dynamic, therefore the page title, meta's, etc are the same, however the products displayed are different. I don't want to exclude the parameter page= completely, as the products are different on each page and obviously I would want the products to be indexed. However, at the same time my concern is that have these parameters might be causing some confusion an hence why I noticed a drop in google rankings. I also want to note - with my market, its not needed to break these pages up to target more specific keywords. Maybe using something like this would be the appropriate measure?
Algorithm Updates | | Southbay_Carnivorous_Plants0 -
Website evaluation questions-what to ask a client
I am looking to make a list of go-to questions when I talk to clients on the phone. What are some good questions that would help me evaluate their website/internet goals?
Algorithm Updates | | StreetwiseReports0 -
Question about Local / Regional SEO
Good Morning Moz Community, I have a local SEO/regional SEO question. I apologize if this question is duplicated from another area on this forum but, a query of the term Regional SEO showed no results, as did similar queries. Please preference this entire question with "Knowing what we know about the most recent changes to local search" I know what has worked in the past, my concern is Now. Working with a heavily regulated client that is regional, mostly East Coast US. They are in Financial Services and state licensing is a requirement. They are licensed in 15 states. Obviously, it would look foolish, in this day in age, to Title Tag individual pages with local modifiers and have numerous pages covering a similar topic with not much difference than localized modifiers in front of the keyword. I've never found that SE's can understand broad regional terms such as New England or Mid Atlantic or Southeast or Northeast, if someone knows different please share. Aside from an exact match search. The client does have 7 offices in various states. Perfectly matching and consistent listings in G Places, Bing Local and Yahoo Local was step one and all their locations are now in those services and there are many more smaller local citation listings are in the works. We have also successfully implemented a plan to generate great reviews from actual customers, for each location, they're receiving a few a day right now. Their local places listings, where they have physical locations, are doing very well but: 1. What would the community's suggestion be on generating more targeted traffic in the 8 states where they have no physical location? 2. The client wants to begin creating smaller blogs that are highly localized to the states and major population centers that they do not have a physical location in. There is an open check book to dedicate to this effort however, I do a lot of work in this industry so I want to offer the best possible, most up to date advice, my concern is that these efforts will have two results: a. be obscured by the ”7 pack" by companies with local brick and mortar b. would detract from the equity built in their existing blog by generating content in other domains, I would prefer to continue growing the main blog. 3. As a follow up, it has been documented that Google is now using the same algorithm for local, personal and personalized, that being the case, is there any value in building links to you Places page? Can you optimize your Places page by using the same off site techniques as you would traditionally? Sorry to kill you with such a long question on a Sunday 🙂
Algorithm Updates | | dogflog1 -
Google new update question
I was just reading this, http://www.entrepreneur.com/blog/220662 We have our official site, which has 200+ service pages, which we wrote once and we keep doing SEO for them, so they rank high all the time. Now my question is, how does Google handle the site freshness ? Service static pages or if we are adding blog items, then also they consider them as fresh site, right ? So, we dont have to update those service pages, right ?
Algorithm Updates | | qubesys0