Does Open Site Explorer purposefully not crawl some sites?
-
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
-
If only we had Google's computer budget, or even their food budget, to throw into our server farm! We do realize that we can't cover everything and that for an audit you will need multiple tools. Keep in mind that Bing offers link information, even for sites you haven't verified in their Webmaster Tools.
-
Thanks for responding Keri. The fact that OSE crawls higher quality sites is great from a link building perspective. However, from a link audit perspective, which is so important these days, it does not give me the information I need to research poor quality links. This forces me to rely on multiple tools.
Thanks again!
Megan
-
We do try to crawl higher-quality sites and show some of the better, more meaningful links to you.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is it possible to block Moz from crawling sites?
Hi, is it possible to stop Moz from crawling a site at the server level? Not that I am looking to do this or anything, but here's why I'm asking. I have been crawling a site that is managed (currently by 2 parties), and I noticed that this week pages crawled went from 80 (last week) to 1 page!! I know, what? See my image attached... and the issues all went to zero "0"....! So is it possible that someone can't prevent Moz from crawling the site at the server level? I checked the robots.txt file on the site, but nothing there. I'm curious. dYNUwjd.jpg
Moz Pro | | co.mc0 -
What do I do about accessing open site explorer?
I am stuck in the redirect loop which seems to have become commonplace when seeking to access open link explorer... I have cleared my cache. I have reset and restarted my browser. And I think I have done what I need to do with cookies. Someone please help me - I am using 10.6.8 OSX - Safari - but have also tried chrome thanks in advance be blessed bd
Moz Pro | | creativeguy0 -
Can i force another crawl on my site to see if it recognizes my changes?
i had a problem w/dup content and titles on my site, i fixed them immediately and im wondering if i can run another crawl on my site to see if my changes were recognized thanks shaun
Moz Pro | | daugherty0 -
Open Site Explorer - SEO - Company Back Links not visible?
Hi Guys, I am relatively new to the SEO community and have what is hopefully a pretty quick and simple question? I have recently outsourced some of my SEO campaigns to an Australian SEO group which were referred to me buy a friend, and i do not have the time to manage all sites SEO. On pitch the SEO company said they had in excess of 7000 domains, and they would implement a massive back linking strategy for me anywhere upwards of 200 links a month and all legit. Initially there were some basic header and title tag changes needed on the site, and I am now in month 4 of my campaign. Looking forward to using SEOMOZ service and specifically Open Site Explorer, I entered my URL but to my disappointment I could only see 4 links and two I was responsible for. I spoke to the SEO company who responded Open Site Explorer wasn't a good indication of back links and that a lot of their sites were not on the network because of the structure of their linking being only one way. I would appreciate a second opinion (external of this company) on this because of my short time learning and dabbling with SEO. On a side note thoroughly enjoying learning SEO and my journey as part of the SEOMOZ community. Appreciate any feedback or responses I get. Kind regards Bodie http://www.berkeleyriver.com.au
Moz Pro | | Bodie0 -
How long do old links stay in Open SIte Explorer stats?
Hi, In Open Site Explorer has around 2000 External followed links which would be great if it was true. I think the issue is that before my site wasn't appending slashes to the url so I think it was counting links from http://mydomain/page1 to http://mydomain/page2/ as an external link (could be wrong here). I corrected this a couple of months ago but I still seem to have over 2000 External links. When I look at the linking pages many of them are "sans slash" and have old anchor text in the link. How long does it take of OSE to update these stale links it there any way I can prompt it to take aciton?
Moz Pro | | moesian0 -
How to force a recrawl of a site?
Hi, I made changes in my site. I would like to see the result of the crawl diagnostic. I know the crawl is happening every week, however, is there a way to force a re-crawl in order not to have to wait 5 days? Cheers,
Moz Pro | | nuxeo0 -
SEOmoz crawl error questions
I just got my first seomoz crawl report and was shocked at all the errors it generated. I looked into it and saw 7200 crawl errors. Most of them are duplicate page titles and duplicate page content. I clicked into the report and found that 97% of the errors were going off of one page It has ttp://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20 http://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20__quickjump__A__name_box__begins__name__A__quickjump__E etc Has 20 pages of slight variations of this link. It is all my members list or a search of my members list so it is not really duplicate content or anything. How can I get these errors to go away and make search my site is not taking a hit? The forum software I use is IPB.
Moz Pro | | NoahGlaser780