Difference between SEOMOZ and Webmaster Tools information
-
Hello,
There is an issue that confuses me and I thought perhaps you will be able to help me shed some light on it.
I have a website which shows 2,549 crawled pages on SEOMOZ and 24,542 pages on webmaster tools!
Obviously there is some technical issue with the site, but my question is: why the vast difference between what the SEOMOZ crawl report and webmaster tools report show?
Thanks!
Guy Cizner
-
Thanks for stepping in everyone, though it looks like we were trying to answer the wrong question. This one is with Roger's crawl of the OP's own site, rather than links indexed in OSE.
Guy, do you have a feel for how many pages SHOULD be in the index? If you only have a couple of thousand pages, then it could be that Google is crawling and indexing some parameters. If you've got 20k+ pages in the index, then Roger isn't finding some things.
Also..are you looking at perhaps just the www.domain subdomain in SEOmoz and is GWT looking at the entire site? If you had a compact www.domain site, but then had forum.domain and wiki.domain, and GWT was reporting pages for all of the subdomains on domain.com, that would explain things too.
-
hello
thanks for all the replies.
the pages crawled are part of an SEO I am running.
How the crawl is done when a campaign is defined?
I assume all the site is being crawled.
thanks
-
This may also shed some light:
Oct 9, 2012 Keri Morgret On-site Community Manager at SEOmoz:
Another reason is that we just don't have the same size server farm that Google and Bing have. We could crawl all of Twitter and get nothing else crawled, or we could crawl some of Twitter, and some of the rest of the web. We aren't able to crawl all of the web, and we release a new index about once a month, so that's why you don't see all of your links or see them right away.
However, what we do offer that is different from Google and Bing is that we show you links for sites that are not your own, we add metrics about the trust and authority of the page, etc.
-
The Mozscape index, as brilliant as it is, can in no way compete with the size of the index that Google can handle.
As a result, your WMT report should always have a bigger amount of pages, links etc crawled. It's just bigger.
-
Either those 'issues' might be the cause. For example incorrect canonicalization that is picked up differently by Google and the SEOmoz bot Roger. Another option could be that Google tries really hard to index each and every page of the web, while Roger has a slightly more restrictive way of crawling the web by only crawling pages above a certain level of authority / only a certain amount of clicks from the homepage etc.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonical issues using Screaming Frog and other tools?
In the Directives tab within Screaming Frog, can anyone tell me what the difference between "canonicalised", "canonical", and "no canonical" means? They're found in the filter box. I see the data but am not sure how to interpret them. Which one of these would I check to find canonical issues within a website? Are there any other easy ways to identify canonical issues?
Technical SEO | | Flock.Media0 -
Remove Directory In Webmaster Tools
Hey Moz'erz, I'm removing some URLS from the index and want to confirm the use of the "remove directory" request. If my structure is this: /blogs/customer-success-stories/tagged/ --- all pages that are /tagged/abc, /tagged/dce etc. will be removed correct? First time trying a directory removal as their are 100 plus of these tagged pages. Comments, suggestions and past experiences welcome!
Technical SEO | | paul-bold0 -
Duplicate content on Product pages for different product variations.
I have multiple colors of the same product, but as a result I'm getting duplicate content warnings. I want to keep these all different products with their own pages, so that the color can be easily identified by browsing the category page. Any suggestions?
Technical SEO | | bobjohn10 -
Seomoz Can not Crawl My Site
Hello there Seomoz can not crawl my site. It's been 3 days now not a single page has been crawled. I deleted the campaign and tried again still now crawl not a single page.. Any solutions??
Technical SEO | | ExpertSolutions0 -
Web Master Tools: change of address
Hello, Hope you can help with an issue I'm having:www.brand-kw1-kw2.com (eg name of course) has moved to www.brand.comAll settings are done - like I did before when moving and setting up a new domain for an older site. (30q redirects - all versions are verified in WMT).However, when the change of adress features is "called out" I get the message: "We couldn't verify www.brand-kw1-kw2.com To submit a change of address, www.brand-kw1-kw2.com must be verified using the same method as brand-kw1-kw2.com. Add www.brand-kw1-kw2.com to your account and verify ownership, then try again." So dose it basically saying that I have to use the same method to verify both the www and non-www version ? Dose it make sense ? It sounds silly. Again, all version are verified and visibile in WMT already - I don't know how in the past those verifications were done but everything is looking good now. Is here a fix for this issue ? (I've moved several but this is the first issue I've encountered) Many thanks.
Technical SEO | | eyepaq0 -
Adding Google + to SEOmoz
I wanted to add my google + signature to every post I make on SEOmoz and I think every user should do the same... Two reasons why... Google helps our existence so we should help theirs. If someone likes what I wrote or vice versa we should be able to follow each other in a simple click. In my opinion all blogs forum posts etc... should Lead to a user not a website, this will prevent spam and help people network. In other words blog spammers and forum spammers will be SOL (Which they all ready are lol).
Technical SEO | | SEODinosaur0 -
Webmaster Tools Site Map Question
I have TLD that has authority and a number of micro-sites built off of the primary domain. All sites relate to the same topic, as I am promoting a destination. The primary site and each micro-site have their own CMS installation, but the domains are mapped accordingly. www.regionalsite.com/ <- primary
Technical SEO | | VERBInteractive
www.regioanlsite.com/theme1/ <- theme 1
www.regioanlsite.com/theme2/ <- theme 2
www.regionalsite.com/theme3/ <- theme 3 Question: Should my XML site map for Webmaster Tools feed all sites off of the primary domain site map or are there penalties for this? Thanks.0 -
Wildly different topics on one domain? (hobby blogger)
Hello Mozzers, Let's say I have a lot of knowledge about a range of different subjects, for example: bicycle maintenance wildlife photography tennis racket re-stringing brewing beer windsurfing holidays I would like to share all of my knowledge in blog format with lots of good content, instructions, videos etc. What is the best way to set up my blogging empire?!... a) Use separate domains for each subject: www.BRANDbicyclemaintenance.com, www.BRANDbrewingbeer.com b) Use one brand domain with sub directories: www.BRAND.com/bicycle-maintenance/, www.BRAND.com/brewing-beer/ b) Use sub-domains: bicyclemaintenance.BRAND.com, brewingbeer.BRAND.com (I would like to achieve good rankings & traffic in order to generate a small income from these sites)
Technical SEO | | Tman30