Difference between SEOMOZ and Webmaster Tools information
-
Hello,
There is an issue that confuses me and I thought perhaps you will be able to help me shed some light on it.
I have a website which shows 2,549 crawled pages on SEOMOZ and 24,542 pages on webmaster tools!
Obviously there is some technical issue with the site, but my question is: why the vast difference between what the SEOMOZ crawl report and webmaster tools report show?
Thanks!
Guy Cizner
-
Thanks for stepping in everyone, though it looks like we were trying to answer the wrong question. This one is with Roger's crawl of the OP's own site, rather than links indexed in OSE.
Guy, do you have a feel for how many pages SHOULD be in the index? If you only have a couple of thousand pages, then it could be that Google is crawling and indexing some parameters. If you've got 20k+ pages in the index, then Roger isn't finding some things.
Also..are you looking at perhaps just the www.domain subdomain in SEOmoz and is GWT looking at the entire site? If you had a compact www.domain site, but then had forum.domain and wiki.domain, and GWT was reporting pages for all of the subdomains on domain.com, that would explain things too.
-
hello
thanks for all the replies.
the pages crawled are part of an SEO I am running.
How the crawl is done when a campaign is defined?
I assume all the site is being crawled.
thanks
-
This may also shed some light:
Oct 9, 2012 Keri Morgret On-site Community Manager at SEOmoz:
Another reason is that we just don't have the same size server farm that Google and Bing have. We could crawl all of Twitter and get nothing else crawled, or we could crawl some of Twitter, and some of the rest of the web. We aren't able to crawl all of the web, and we release a new index about once a month, so that's why you don't see all of your links or see them right away.
However, what we do offer that is different from Google and Bing is that we show you links for sites that are not your own, we add metrics about the trust and authority of the page, etc.
-
The Mozscape index, as brilliant as it is, can in no way compete with the size of the index that Google can handle.
As a result, your WMT report should always have a bigger amount of pages, links etc crawled. It's just bigger.
-
Either those 'issues' might be the cause. For example incorrect canonicalization that is picked up differently by Google and the SEOmoz bot Roger. Another option could be that Google tries really hard to index each and every page of the web, while Roger has a slightly more restrictive way of crawling the web by only crawling pages above a certain level of authority / only a certain amount of clicks from the homepage etc.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links in Webmaster Tools that aren't really linking to us
I've noticed that there is a domain in WMT that Google says is linking to our domain from 173 different pages, but it actually isn't linking to us at all on ANY of those pages. The site is a business directory that seems to be automatically scraping business listings and adding them to hundreds of different categories. Low quality crap that I've disavowed just in case. I have hand checked a bunch of the pages that WMT is reporting with links to us by viewing source, but there's no links to us. I've also used crawlers to check for links, but they turn up nothing. The pages do, however, mention our brand name. I find this very odd that Google would report links to our site when there isn't actually links to our site. Has anyone else ever noticed something like this?
Technical SEO | | Philip-DiPatrizio0 -
Merge two different domains into one
Hi all SEO folks We want to merge two different domains into one. The products are similar to each other but domain1 is the online product and domain2 is the offline version of the product (new launced product). Both the domains have the domain Authority 47 but domain1 is optimized to the online product and most keywords (branded keywords) are in top 3 , where as the domain2 has been used for another concept which has now been closed down (beginning of may), and replaced with the offline product. To boost the sale of the offline product, we want to move the content from domain1(online product) to domain2(offline product), and off course we want to keep the ranking in top 3. So this is what I know I have to do: Redirect 301 from old content url to new content url, contact external domains and ask them to link to the new domain. Furthermore I read that it is important to place everything from the old site exactly the same way on the new site (and keep the content the same), and that way keep the internal url structure/linkjuice. This is were my question comes in. If we move all the content to the exactly same location on the new site, there will be way to many links on the frontpage and the new offline product won't have the dominating position.
Technical SEO | | Bulpen
Do any of you have experience with moving the content from one domain1.com to domain2.com/online and still be able to keep the ranking in SERP, or would you recommend always to move the content from root to root? Ps: Sorry about my English. English is not my main language. Hope you understand my question anyway :).0 -
How different should content be so that it is not considered duplicate?
I am making a 2nd website for the same company. The name of the company, our services, keywords and contact info will show up several times within the text of both websites. The overall text and paragraphs will be different but some info may be repeated on both sites. Should I continue this? What precautions should I take?
Technical SEO | | savva0 -
Setting a geographic target in webmaster tools
If a site is targeting traffic from around the world should I set the geographic targeting in webmaster tools under 'settings' or leave it? Any help would be much appreciated!
Technical SEO | | SamCUK0 -
Different links to to the same page
Hi, Based on the user's actions we post activity into users Facebook timeline. And each activity has link back to our particular page on our website. For example if original page was: www.Domain.com from Facebook timeline it would be like this: www.Domain.com?Ffb_action_ids=101508953168 Do you think this will have a negative effect on our page rankings as we will eded up having a lot of different URL's to the same page? www.Domain.com?Ffb_action_ids=101508953168 www.Domain.com?Ffb_action_ids=456788765609 etc.. Thank you, Karen Bdoyan
Technical SEO | | showme0 -
Duplicate page content errors in SEOmoz
Hi everyone, we just launched this new site and I just ran it through SEOmoz and I got a bunch of duplicate page content errors. Here's one example -- it says these 3 are duplicate content: http://www.alicealan.com/collection/alexa-black-3inch http://www.alicealan.com/collection/alexa-camel-3inch http://www.alicealan.com/collection/alexa-gray-3inch You'll see from the pages that the titles, images and small pieces of the copy are all unique -- but there is some copy that is the same (after all, these are pretty much the same shoe, just a different color). So, why am I getting this error and is there any best way to address? Thanks so much!
Technical SEO | | ketanmv
Ketan0 -
Does Selling the Same Product on Different Domains Look Spammy?
Today, I have watched such a great video on YouTube from Google Webmaster Help with following subject. Does selling the same product on three different domains look spammy? Now, I have same issue with my three websites. You can find out details as follow. Traditional Table Lamp in Brushed Steel Finsih with Green Glass http://www.lampslightingandmore.com/50_63_21594/traditional-table-lamp-in-brushed-steel-finsih-with-green-glass.html http://www.vistastores.com/indoorlighting-roycelighting-rtl50091-12b.html 7.5' Patio Umbrella Push Tilt - Olefinhttp://www.vistapatioumbrellas.com/marketumbrellas-californiaumbrella-slpt758-f13-red.htmlhttp://www.vistastores.com/marketumbrellas-californiaumbrella-slpt758-f13-red.htmlThere are three different website with 4000+ same products, same Title tag, same Meta description, same price, same details, same SKU number, same images and same details.There are very few pages indexed by Google for VistaStores.com. [I have submitted series of question on SEOmoz Q & A forum to resolve my website's crawling issue.]I assume that, this is one of biggest reason to stop my crawling. So, How can I fix it?
Technical SEO | | CommercePundit0