Can Google see all the pages that an seomoz crawl picks up?
-
Hi there
My client's site is showing around 90 pages indexed in Google. The seomoz crawl is returning 1934 pages.
Many of the pages in the crawl are duplicates, but there are also pages which are behind the user login.
Is it theoretically correct to say that if a seomoz crawl finds all the pages, then Google has the potential to as well, even if they choose not to index?
Or would Google not see the pages behind the login? And how come seomoz can see the pages?
Many thanks in anticipation!
Wendy
-
Well, that could be your easy solution. Make sure they're all set not to be indexed, then you'll be able to (mostly) ensure Google won't crawl them, and they'll probably disappear from your moz crawl report as well. As far has how moz is finding them to begin with behind your login wall, sorry, I have no idea.
-
The pages behind the login? No not yet - they are a new client, so I am just auditing at the moment to identify what we need to do
Many thanks for your replies!
-
This may be an obvious question, but to you have those pages set to noindex?
-
Hi Marisa
seomoz are crawling unecessary pages, (they return pages ignored by screaming frog for example)
BUT my concern is that if Google can also see them, even if they choose to ignore them my client maybe getting slammed for duplicate issues or the pages behind the login may suddenly appear in the index.
We'll get no index / no follow added, and fix the dupes, but am really interested as to how seomoz sees behind the login
-
Here's the real question: Do you WANT Google to see all these pages, or is SEOmoz crawling unnecessary pages?
-
Great, many thanks Nakul - they are a new client so am waiting on getting access to WMT - will go through with a fine tooth comb! Just seems really weird with regards to the pages behind the login ...
-
Wendy, if SEOMOZ can see it, I am sure Google can see it as well. I would login to your webmaster console and check the index status. Do you have an XML sitemap submitted for your website ? Once you do, you'll have a more accurate read on the number of pages you submitted and how many of them are indexed. The new index status Google introduced last month also lets you see pages Google ignored for multiple reasons.
I hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can check my site
can you please tell me what should I do with this site I trying a lot to solve its issues. the link is here https://alazharquranteaching.com/
Moz Pro | | saharali150 -
Moz can't see my link from an external site
Hi, I'm hoping someone can shed some light on this. I've had a followed link created from http://www.dubaisharks.com/ pointing to my website - http://www.yallarugby.com but in the reports it doesn't show that there is a link coming fro this website. The link has been active for a few months now, but still no record of it. Any ideas?
Moz Pro | | SeoSheikh0 -
SEOMoz On-Page Report Card
This question is for one of the SEOMoz staff. With the ongoing changes and improvement in algorithms, does the SEOMoz team keep the "On-page Report Card" up to date with best practices?
Moz Pro | | tdawson090 -
Help with URL parameters in the SEOmoz crawl diagnostics Error report
The crawl diagnostics error report is showing tons of duplicate page titles for my pages that have filtering parameters. These parameters are blocked inside Google and Bing webmaster tools. I do I block them within the SEOmoz crawl diagnostics report?
Moz Pro | | SunshineNYC0 -
Tried to find correlation between SEOMOZ statistic and google ranking.
I've made Google US search and than tried to compare SEOMOZ data for first few result. I've used Open Site Explorer and On-Page Report Card. On attached picture you can find this statistic. Pages are sorted in order as they appear in Google search. For me is big question why position 2 and 4 is so hight and 6 is only 6. And what position 6 should do to go up. Thank you. 2s9zlu8.jpg
Moz Pro | | ctam0 -
Do Google's recent changes effect the data SEOmoz delivers
Since Google made privacy changes and certain keyword tools such as MS have had to make drastic changes to continuing to be usefull, has SEOMoz encountered any problems and is your keyword data as reliable and accurate as before the Google change?
Moz Pro | | penandzeke0 -
Why are we not ranking? We have done all we can think of. Can you help?
We have an old domain that we have had for years now. And recently. December, we completely redesigned the site, I mean a complete overhaul, design, architecture, asp to php for example. Resubmitted to google via webmaster with a new site map etc. Our website for reference is www.completeoffice.co.uk. We are trying to rank in UK google, www.google.co.uk, for the term office refurbishment kent (we are on page 2) and office refurbishment (we are on page 17). This is confusing me, because thats 7 pages lower than we were originally, before the site design, its better seo wise, duplicate content is none, title tage meta tags all correct, domain authority has doubled from 12 to 24 in a few months all in an effort to rank better. our homepage and office refurb pages both got an A on the on page SEOmoz tool test. So we dont understand why we are not ranking highly. It seems sites, much uglier and less seo friendly than our with same or lower domain authority are ranking at least 10 pages higher than us. Why is this? Can anyone help or give us a few suggestions. All help greatly appreciated. SEOmozzers.
Moz Pro | | CompleteOffice0