Can Google see all the pages that an seomoz crawl picks up?
-
Hi there
My client's site is showing around 90 pages indexed in Google. The seomoz crawl is returning 1934 pages.
Many of the pages in the crawl are duplicates, but there are also pages which are behind the user login.
Is it theoretically correct to say that if a seomoz crawl finds all the pages, then Google has the potential to as well, even if they choose not to index?
Or would Google not see the pages behind the login? And how come seomoz can see the pages?
Many thanks in anticipation!
Wendy
-
Well, that could be your easy solution. Make sure they're all set not to be indexed, then you'll be able to (mostly) ensure Google won't crawl them, and they'll probably disappear from your moz crawl report as well. As far has how moz is finding them to begin with behind your login wall, sorry, I have no idea.
-
The pages behind the login? No not yet - they are a new client, so I am just auditing at the moment to identify what we need to do
Many thanks for your replies!
-
This may be an obvious question, but to you have those pages set to noindex?
-
Hi Marisa
seomoz are crawling unecessary pages, (they return pages ignored by screaming frog for example)
BUT my concern is that if Google can also see them, even if they choose to ignore them my client maybe getting slammed for duplicate issues or the pages behind the login may suddenly appear in the index.
We'll get no index / no follow added, and fix the dupes, but am really interested as to how seomoz sees behind the login
-
Here's the real question: Do you WANT Google to see all these pages, or is SEOmoz crawling unnecessary pages?
-
Great, many thanks Nakul - they are a new client so am waiting on getting access to WMT - will go through with a fine tooth comb! Just seems really weird with regards to the pages behind the login ...
-
Wendy, if SEOMOZ can see it, I am sure Google can see it as well. I would login to your webmaster console and check the index status. Do you have an XML sitemap submitted for your website ? Once you do, you'll have a more accurate read on the number of pages you submitted and how many of them are indexed. The new index status Google introduced last month also lets you see pages Google ignored for multiple reasons.
I hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Which is the better keyword strategy? Specifying page or seeing what ranks?
I recently began using another third-party tool that requires a list of keywords and the URLs I want those keywords to rank on (for example, "vegetarian recipes" on www.123.com/vegetarian-recipes). Is this a better strategy than using the Moz ranking tool to see which pages on my domain my target keywords are already ranking for? I can see how the former might mean we miss opportunities but the latter doesn't necessarily show how my priority pages are doing for specific keywords.
Moz Pro | | RikkiAyers1 -
Your site's pages may be using techniques that are outside Google's Webmaster Guidelines
Hi All The message below I received from google webmaster, please tell me how I solve this problem Dear site owner or webmaster of http://testedfatburners.com/, We've detected that some of your site's pages may be using techniques that are outside Google's Webmaster Guidelines. If you have any questions about how to resolve this issue, please see ourWebmaster Help Forum for support. Sincerely, Google Search Quality Team
Moz Pro | | mkm1040 -
Can't disconnect or change Google Analytics profile
I would like to change the Google Analytics profiles for my SEOmoz campaigns. But every time I try to disconnect or change profile, the request timeout. What to do?
Moz Pro | | Bownty0 -
Crawl Diagnostics: Next crawl date is in the past
Hi - I have quite a few crawl diagnostic errors and warnings. I have attempted to fix many of them but noticed this note at the bottom of the crawl diagnostics chart: "Last Crawl Completed: Mar. 22nd, 2013 Next Crawl Starts: Mar. 29th, 2013" It looks like SEOMoz thinks the next crawl date is Mar 29th, 2013, which is two weeks ago. Is there any way to "force" the crawl and get it back on regular schedule? This may have happened when my account was disabled because my credit card expired...Thoughts?
Moz Pro | | 6thirty0 -
Seomoz puts hyphen and company name after page title in the report, why?'
Hi Community, Can you figure out why this is happening? The title in the url itself does not contain - CodeBaby. Thank you! W6yg1cJ.png
Moz Pro | | CodeBaby0 -
After fixing errors can I re-crawl for diagnostics?
As I am fixing errors will the campaign automatically update to show where I have fixed issues?
Moz Pro | | eidna220 -
SEOmoz vs Google Webmaster Tools on incoming links
I'm working on basic SEO for http://queueassoc.com. Google has indexed the non-www verions of the pages and these are what the SERPS return SEOmoz toolbar shows that all of the incoming links juice goes to the www. versions of the pages, none to the non-www version. Yesterday I set up GWMT for the site, submitted a sitemap with the www version of the pages and set the default address to the www version. I had to verify both versions of the site in order to do this and in looking at the non-www version I saw that Google had all the incoming links there and none in the www.version, the opposite of what SEOmoz shows. Is this just because Google only has the non-www versions in its index? Will they show the links to the www version once they get them in the index? I'm worried about losing Google Page Rank value or SEOmoz DA by making this switch.
Moz Pro | | bvalentine0 -
Is anyone noticing a difference between Google position when you view ten and when you view a hundred results per page?
We have noticed a gap as large as 30 places when using UK Google. Interested in whether other people are seeing this and if anyone can offer an explaination. Thanks Turkey
Moz Pro | | Turkey0