Can Google see all the pages that an seomoz crawl picks up?
-
Hi there
My client's site is showing around 90 pages indexed in Google. The seomoz crawl is returning 1934 pages.
Many of the pages in the crawl are duplicates, but there are also pages which are behind the user login.
Is it theoretically correct to say that if a seomoz crawl finds all the pages, then Google has the potential to as well, even if they choose not to index?
Or would Google not see the pages behind the login? And how come seomoz can see the pages?
Many thanks in anticipation!
Wendy
-
Well, that could be your easy solution. Make sure they're all set not to be indexed, then you'll be able to (mostly) ensure Google won't crawl them, and they'll probably disappear from your moz crawl report as well. As far has how moz is finding them to begin with behind your login wall, sorry, I have no idea.
-
The pages behind the login? No not yet - they are a new client, so I am just auditing at the moment to identify what we need to do
Many thanks for your replies!
-
This may be an obvious question, but to you have those pages set to noindex?
-
Hi Marisa
seomoz are crawling unecessary pages, (they return pages ignored by screaming frog for example)
BUT my concern is that if Google can also see them, even if they choose to ignore them my client maybe getting slammed for duplicate issues or the pages behind the login may suddenly appear in the index.
We'll get no index / no follow added, and fix the dupes, but am really interested as to how seomoz sees behind the login
-
Here's the real question: Do you WANT Google to see all these pages, or is SEOmoz crawling unnecessary pages?
-
Great, many thanks Nakul - they are a new client so am waiting on getting access to WMT - will go through with a fine tooth comb! Just seems really weird with regards to the pages behind the login ...
-
Wendy, if SEOMOZ can see it, I am sure Google can see it as well. I would login to your webmaster console and check the index status. Do you have an XML sitemap submitted for your website ? Once you do, you'll have a more accurate read on the number of pages you submitted and how many of them are indexed. The new index status Google introduced last month also lets you see pages Google ignored for multiple reasons.
I hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SeoMoz keyword page grader report card
Hi Ive recently 301 redirected old pages/urls to new pages/urls due to a site redesign. The seomoz kw report card is still reporting the old urls though with a significantly reduced score for most pages (i.e. from A's to now C's, from B to now D's etc). Does this mean mozbot is following the 301's & its actually the new urls being graded as such or is it referring to the old pages ? I will be adding the new urls to report card shortly but just interested in clarifying the above since i would have thought, if it is the old pages, they would not be reporting any score for those, or its scoring the new pages ? Many Thanks Dan
Moz Pro | | Dan-Lawrence0 -
Wordpress.com does no allow google analytics will that effect my seo campaign started with seomoz?
Hello All, Since I have my domain mapped to wordpress.com site which does not allow google analytics ... I am worried if it would effect my seo campaign out here . While i see on the seomoz platform, i am being prompted for analytics I wish to know if its ok running seo campaign without analytics ? If not , what should i do to avail analytics ??
Moz Pro | | mysayindia0 -
Why SEOmoz bot consider these as duplicate pages?
Hello here, SEOmoz bot has recently marked the following two pages as duplicate: http://www.virtualsheetmusic.com/score/PatrickCollectionFlPf.html?tab=mp3 http://www.virtualsheetmusic.com/score/PatrickCollectionFlPf.html?tab=pdf I don't personally see how these pages can be considered duplicate since their content is quite different. Thoughts??!!
Moz Pro | | fablau0 -
How Can I View Last Week's Page Grading?
How can I see all my on-page grading reports for page grading optimization that decreased for the worse from last week - so as to know which pages to fix? My mozpro email report indicates only ten of them decreased from Grad B to C etc from last week. As I have just migrated to a new cms, I need to find and bring back to grade all effected pages. I can't find how to view historical page grades - just for last weeks. Any ideas anyone? Thanks!
Moz Pro | | emerald0 -
Why can't I get the search volume data from Google in the Keyword difficulty tool?
Hi, For some reason I can't get the traffic data from Google. when I'm doing a keyword research via the Difficult tool then i need to check the keywords volume in Google Adwords and copy the words into MOZ's keyword tool to check feasibility. mZGRSbC.png?1
Moz Pro | | Indiatravelz0 -
What tools can I use to crawl a site which uses #! hasbhang?
I have a site which was created in a way that it uses hasbang #!. I am using 3 different SEO tools and they can't seem to crawl the website. Or what suggestion can you give me in dealing with hasbang. Any ideas please. Thanks a lot for your help. Allan
Moz Pro | | AllanDuncan0 -
Why are we not ranking? We have done all we can think of. Can you help?
We have an old domain that we have had for years now. And recently. December, we completely redesigned the site, I mean a complete overhaul, design, architecture, asp to php for example. Resubmitted to google via webmaster with a new site map etc. Our website for reference is www.completeoffice.co.uk. We are trying to rank in UK google, www.google.co.uk, for the term office refurbishment kent (we are on page 2) and office refurbishment (we are on page 17). This is confusing me, because thats 7 pages lower than we were originally, before the site design, its better seo wise, duplicate content is none, title tage meta tags all correct, domain authority has doubled from 12 to 24 in a few months all in an effort to rank better. our homepage and office refurb pages both got an A on the on page SEOmoz tool test. So we dont understand why we are not ranking highly. It seems sites, much uglier and less seo friendly than our with same or lower domain authority are ranking at least 10 pages higher than us. Why is this? Can anyone help or give us a few suggestions. All help greatly appreciated. SEOmozzers.
Moz Pro | | CompleteOffice0