Does Open Site Explorer purposefully not crawl some sites?
-
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
-
If only we had Google's computer budget, or even their food budget, to throw into our server farm! We do realize that we can't cover everything and that for an audit you will need multiple tools. Keep in mind that Bing offers link information, even for sites you haven't verified in their Webmaster Tools.
-
Thanks for responding Keri. The fact that OSE crawls higher quality sites is great from a link building perspective. However, from a link audit perspective, which is so important these days, it does not give me the information I need to research poor quality links. This forces me to rely on multiple tools.
Thanks again!
Megan
-
We do try to crawl higher-quality sites and show some of the better, more meaningful links to you.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Open Site Explorer CSV export limit?
Hi! Something has been puzzling me. I've filter down a few things within open site explorer to produce some links of interest to me - around 500 records are showing When I try to export it via CSV however, only 25 links appear? Anyone know why and how I can get the rest?? David
Moz Pro | | rejigdigital0 -
Crawl Diagnostics
Hello, I would appreciate your help on the following issue. During Crawl procedure of e-maximos.com (WP installation) I get a lot of errors of the below mentioned categories: Title Missing or Empty & Missing Meta Description Tag for the URLs: http://e-maximos.com/?like_it=xxxx (i.e. xxxx=1033) Any idea of the reason and possible solution. Thank you in advance George
Moz Pro | | gpapatheodorou0 -
Seomoz and site explorer completely different
seomoz and site explorer completely different results on own site and competitors on moz i am ahead in all aspects in site explorer i am way off par...why
Moz Pro | | lordmoose85450 -
Crawl Diagnostics - unexpected results
I received my first Crawl Diagnostics report last night on my dynamic ecommerce site. It showed errors on generated URLs which simply are not produced anywhere when running on my live site. Only when running on my local development server. It appears that the Crawler doesn't think that it's running on the live site. For example http://www.nordichouse.co.uk/candlestick-centrepiece-p-1140.html will go to a Product Not Found page, and therefore Duplicate Content errors are produced. Running http://www.nhlocal.co.uk/candlestick-centrepiece-p-1140.html produces the correct product page and not a Product Not Found page Any thoughts?
Moz Pro | | nordichouse0 -
Open site Explorer CSV output mixed up
If I download a CSV output of the external links and the characteristics of them, the output is mixed up. When I put the data in Columns, some columns are disordered. Do more people experience these problems? Is there some preference I have to adapt? Thanks! SFCTf
Moz Pro | | MartijnHoving820 -
Inbound Link Discrepancy: Campaign vs Open Site Explorer
Hello, I am getting starkly different inbound link amounts from Open Site Explorer and my Campaigns tab. Domain 1
Moz Pro | | truckguy77
Campaigns: Total links = 10,895,942 Open Site Explorer - Links = 224,000 Domain 2
Campaigns: Total links = 25,670,287
Open Site Explorer - Links = 157,000 Why would these be so different? For reference, the "Historical Domain Analysis" shows these sites getting exponentially more links starting in February. This is of concern to me. I didn't do anything different in February to get so many more links (especially not in the millions). If anything, I am hoping the "Campaigns" section is simply wrong about this.0 -
Crawl Test produced only 1 page
Hi, I recently submitted a crawl for www.cirrato.com using SEOMoz Crawl Test Tool. I have a lot of pages, but the crawl result shows only 1 page, which is the front page and nothing else... Does anyone know what this could mean or what the problem is?
Moz Pro | | yusufcirrato0 -
How often is Open Site Explorer updated?
Or perhaps my question is actually how often does the seomoz bot crawl the web? I ran some benchmark link counts for a number of websites about this time last month and I noticed when I went to update them for this month the data is the same. Thanks.
Moz Pro | | WCR1