Is Moz's backlink checker.... just... not good?
-
Hey everyone!
Can somebody explain to me why this keeps happening: Whenever I'm trying to backlink my competitors, I typically use RavenTools. Every time, without fail, if I put that same URL into Moz's Open Site Explorer - It gives me about 1/20th of what RavenTools shows me. Sometimes it literally comes up with 2 or 3 links total.
Unfortunately, RavenTools has a cap on how many backlink checks you can perform in a month - so once I've used those up, I have to start using OSE... But, it just doesn't work.
Does anyone else have this issue?
Thanks!
-
Hey there! Tawny from Moz's Help Team here. I think I can help explain why you're seeing fewer links with our tools than with others.
Open Site Explorer and the Link Analysis page of Moz Pro Campaigns are both tied to our Mozscape index, which tends to update roughly once a month.
Just a few points on how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled ~130 billion URLs
The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available!
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories. This tends to bias our index in favor of newer links. Linking data is only stored in the index for around 180 days. After that point, unless the crawler has a compelling reason to return to your site and the sites linking to yours, recrawl and reindex them, those links to your site can fall back out of our index again. That doesn't mean they're not out there on the web affecting your SEO, just that our tools don't see them anymore.
You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time.
Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.
You can read more about how we build our index in our guide here.
I know this is a ton of information, so if you have any questions or if I didn't make anything clear enough, please don't hesitate to ask! You can always drop us a line at help@moz.com and we'll do our best to clear up any questions you might have.
-
Bump.
-
I'm going to comment on here again to bump this post. This is a little aggravating: I ran a report on one of our clients using OSE and it says they have 3 backlinks. I then immediately ran a report on RavenTools and their report says we have 61 backlinks.
Why would I want to use OSE if it is only going to provide me >5% of my client's backlink profiles? I simply don't understand.
-
You are most welcome. And thank you for the followup.
You are right. More results are better. The point I meant to establish was that OSE is not bad even though it could be better. It, like the other tools, provides an accurate slice of a site's back links. The size of that slice depends on the tool's resources.
Equipped to Act Having back link profiles from these tools leaves us equipped to act. I said this in my answer as a blanket statement for link building, disavowing*, content development, and outreach. Here are some quick examples:
Link building — If OSE (or any tool) returns 4 domains for you and 150 for your competition, It's time to get some links. Plug in some competitors to see if there are any gaps you can target, hit up Fresh Web Mentions to focus your outreach, and explore content opportunities.
Disavow* — If your tool returns 4 root domains, 15 total links and one of those is complete spam level 10, I'd probably want to disavow* it and audit my site for more spammy links using GSC. I'd know from the slice of back links Moz provided that my site was likely to have more.
Footnote on Disavowing* Penguin 4.0 has presented some changes for us as to the when and what to disavow. I have not had a recent and significant enough experience with spammy back links to formulate my response yet. If you find yourself the victim of bad back links, do some research before you throw the SEO book at the issue. It might save time.
Cultivate those links,
CopyChrisSEO and the Vizergy Team -
Thanks for the well articulated response, Chris! It's much appreciated.
I'm gonna contest your last statement though, and I'd like to see what you have to say. If I use Moz to check my backlinks, and it gives me (4 root domains, 15 total links) VS. using someone else and getting (150 root domains, X amount of links) ---- How is this a good way to be equipped to act on my backlink portfolio, in regards to using Moz? I wouldn't be able to know if I have spammy backlinks, or a good amount of high quality links?
-
Hello TaylorRHawkins and fellow Mozers,
I have had the pleasure of using all sorts of backlink tools, including OSE and RavenTools. In doing so, I've run into this issue. Clients notice this difference too and frequently bring it to my attention. Here's what I say: These are different tools with different limitations. They give different results because of these limitations, which always come down to resources. Whether it's the software, indexing process, or bots, all of these tools are limited by their resources.
Tools with larger resources typically return more results. However, even more well-funded tools, including Ahref's beefy bot and index, won't get them all. You can see this in action by comparing your site's links—as reported per your chosen tool—to Google Search Console, which Google has pinky-promised us is the full list. You'll see the difference right away.
So is this a bad thing? No, not at all.
The tools I've used (OSE, RavenTools, Ahrefs, SEM Rush, and Brightedge) all do a pretty great job of delivering an accurate slice of my competitor's backlinks across the internet. Take this data and extrapolate the backlink profile using other metrics like domain authority. You'll get a good picture of what they have—and be equipped to act on it—even if you can only see 1/20th of their backlink pie.
Keep crawling,
CopyChrisSEO and the Vizergy Team
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website Backlinks not getting Crawl by Moz?
Hi, I've the query related to backlinks of my website. Some of the high authority sites give backlinks to my website but these links are still not showing in Moz. My website is 6 months old and also continuously getting backlinks from high authority sites but still these are not showing on Moz and also not improving DA and PA of my website. I've also attached the screenshot of Moz link explorer results please check and guide me what to do with website so Moz will consider it and give some authority. And also guide me How much Moz takes time to crawl website backlinks and shown in their link explorer. Website URL: https://www.welderexpert.com Moz Expert Suggestions needed. Thanks, overview?site=welderexpert.com⌖=domain
Link Explorer | | KOidue0 -
Doubt Regarding Moz Spam Score
My website is https://www.whatiscbd.com/ . When I check spam score of whatiscbd.com, moz show that its spam score is 9. And when i search spam score of www.whatiscbd.com, spam score is 0. Although both are same website. Why i am getting such issue. Is there any issue in my website's URL redirection. If yes then what's the issue?
Link Explorer | | HuptechWebseo0 -
Moz Spam Score 9/17 when there are no links
Hi I was just looking at a competitors new site in OSE and it had a DA and PA of 1 which I would expect and also no links, which again I would expect, basically the guy used to design stuff for me and thinks he can do a better job so he is giving it ago. But he has a spam score of 9/17 but no links - how is this even possible. Thanks Andy
Link Explorer | | Andy-Halliday0 -
Does MOZ have a Flash test tool?
I want to test my websites and see if they use Flash, is there a flash check tool like on SEO tool kit here on MOZ? Thanks, Lance
Link Explorer | | BlueprintMM0 -
How is Moz Page Authority Calculated?
Can anyone refer me to a document that explains the measures that go into the calculation of Moz Page Authority? I'm chiefly interested in what counts and what doesn't -- follow links, no-follow links, internal and external, what (if any) on-site factors, etc.
Link Explorer | | GlennFerrell0 -
Just Discovered Links Are Down for ~2-3 Days
UPDATE 12/01/15: This issue is now resolved and Just Discovered Link data is back. Sadly, I've got bad news. Due to an error we made (literally a typo on a curl command), Just Discovered Links in Open Site Explorer will be unavailable for 2-3 days. The data was actually lost, but we're re-indexing all those links now and they should be back in working order by Monday. NOTE: this only affects link counts and links listed in the "Just Discovered" sections of OSE. No links in the main index nor any metrics (PA/DA/etc) are affected. Our sincere apologies - we're going to build mechanisms to prevent this for the future.
Link Explorer | | randfish3 -
What's the Story on Mozscape Updates?
Hey gang, As you may be aware, we were considerably late with our last index release. You have my sincere apologies for that and the apologies of the entire team. In the interest of transparency, I want to try to explain what's been going on. Since stepping down as CEO, I've been asked to take on a few roles in the company. One of those is product architect (basically the product owner) of our Big Data team, who produces the Mozscape link index. For several years, that team has been almost exclusively focused on getting us closer to a near real-time indexing system that does not have scalability issues. Mozscape is currently smaller than our major competitors, and we're also often slower. Our metrics (PA, DA, MozRank, MozTrust, Spam Score, Social Data, etc) have been the unique value we provide, but it's not enough. We need to be competitive on size and freshness. Building a raw link index (without processed metrics like PA/DA et al) is hard, but it's possible. Building a link index with those metrics is really tricky, and requires computer science knowledge and skills far beyond the scope of my understanding. That's what our team's been working on, and they've made some progress, but it's been slow, hampered by unknown unknowns, and materially hurt by a lack of experienced talent we can hire to help (we've had open job posts for years now). In the meantime, our historic Mozscape index structure keeps encountering challenges - this latest round is still somewhat unexplained (we believe there's hardware issues compounded by how the system is architected to handle large domains, but there may be other issues). The team's struggled to split time between keeping the old Mozscape running and hunkering down to finish the new system. I'm trying to help them balance things as best I can, and we're going to be putting effort toward making sure we get index releases out on time. However, to do that, we'll need to scale down size, and then rebuild back up. We think we can do this while also improving the prioritization of which links we crawl (e.g. deeper on important domains that link out, less so on deep pages that don't link anywhere) so the index overall improves. However, I don't want to minimize the risks - we may have some slow updates, some smaller indices, and some less-than-ideal data in the next one or two indices while we work to remedy this issue. I HOPE we don't, and that things actually get better immediately, but we can't promise that until the work gets finished. TL;DR - Mozscape V2 is in development and will let us as big and faster as any link index. In the meantime, current Mozscape's having issues & we're making smaller indices in an attempt to diagnose and repair. As always, thanks for your understanding, continued support, and if you have any questions, feel free to leave them below. I realize that this level of service/product quality is NOT OK, and I'm doing everything in my power to fix it.
Link Explorer | | randfish8 -
Local listings aren't being crawled?
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
Link Explorer | | seomozinator
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO. I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled. I will say that some local listings do appear on very few reports, but far not all of them. So, what can be the problem?0