Discrepancies between google search console and OSE
-
Hi
google search console is showing root linking domains at 297 but OSE only shows 19
This was highlighted because OSE dropped from 50 to 19 since last scan
Regards Paul
-
Hi there Paul,
Sam from Moz's Help Team here! Sorry about the trouble - I know this can seem frustrating and confusing so let me try to explain. Overall, this is due to our method of indexing, which focuses on quality over quantity (if we're providing a summary of it).
When we collect this information for our link index it's actually expected that we won’t find every page and link because we aren’t looking for them all. When we collect this data, we’re looking specifically for the most valuable links and, rather than crawling your entire site or every site, we collect this by starting our crawler on a few highest ranking sites and letting it perform a breadth first search to see what it finds.
For each page that we crawl, we first collect each of it’s links before following these and collecting the details of each page that these link to and so on. There’s a set limit of links that we’ll crawl per page and pages that we’ll crawl per site so it’s expected that we may not follow every link on a site this way (so this means we may not always find all available backlinks/linking domains).
Open Site Explorer and the Link Analysis page of campaigns are both tied to our Mozscape index, which tends to update roughly once a month.
Just a few points on how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled ~130 billion URLs
The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available!
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories.
You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time.
Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.
It's also important to note that OSE is based on link freshness and diversity, so it's possible that older inbound links that were pointing to you have no longer been indexed. Our index only caches the link data it has for around 180 days - after that, unless the tool is prompted to re-crawl those sites, links will fall out of our index and no longer be included, which is why we always recommend consistent and continuous link building.
Generally, we recommend using a wide variety of backlink tools to get the most illustrative picture of how your site's backlink profile looks. OSE and Ahrefs index differently and have different purposes. Ahrefs is good for quantity while OSE is great for finding higher quality links. Domain Authority is our own proprietary metric that is closely correlated to Google rankings, so our customers often use OSE to research influential sites to build links.
I hope this helps - let me know if you have any further questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved How to Disavow links with Google Console
I have a list of links I want to disavow, but I can't because I have a domain property so google console does not let me submit anything. What do I do?
Link Explorer | | Ryka12340 -
Unsolved Why am I not seeing search.yahoo.com in my site's backlink profile?
When looking at the backlinks for a client's competitor I found that they had a backlink on search.yahoo.com/reviews and our domain (harmonyhit.com) did not. I was using the Link Explorer tool. However, when I go to yahoo Search I see that the website of harmonyhit.com is indexed in Yahoo search and has links to the site. Also, it's sitemap has been recently crawled in Bing webmaster tools which Yahoo uses. Why does our client have the backlink accounted for and we do not?
Link Explorer | | DigitalThirdCoast0 -
Am I using OSE wrong?
Hi - new to all this! A link on a competitor site is showing as 404 when I check it with OSE but nothing on the page seems to be broken. It's got loads of links to it, so I'm trying to work out what's going on. I just filtered the results by '40?'. Thanks
Link Explorer | | razor20100 -
How can Ahrefs be better than OSE ?
Dear Sirs and Contributors, I know this question is going to cause revolution, but I am paying for a subscription to moz every single month and I see that Open Site Explorer doesn't find baacklinks for some of my new clients when aHrefs can find more than 16 !! Why is this ? How can a free tool like ahrefs give me more information than OSE for which I pay for ? ;-(
Link Explorer | | Tintanus1 -
Is there a easy way to take all links from O.S.E and add them to My Google WMT.CSV file?
Good morning everyone. I have recently discovered that someone has targeted me with a negative SEO campaign and I have been inundated with 13,000 anchor text links from spam sites pointing to my domain. I have run Open Site Explorer and gotten all of my backlinks on my desktop but what I need to do is add them to the back links .csv file from Google Webmaster Tools so that I can upload the file to my CognitiveSEO campaign. What I would like to know is, does anyone know how to transfer all backlinks from the open site explorer.csv file over to the webmaster tools .csv file in a bulk action without having to copy each link individually? I don't really have any working knowledge of excell in this capacity for SEO so, If anyone could explain how this would be done I would be eternally grateful because adding one link at a time is very painful and very time consuming. Thank you. Cam
Link Explorer | | CamMcArthur0 -
Drastic drop in LRD from OSE report has me confused... Any idea why?
We just got our report from OSE and a week ago we had over 80 LRD's with DA34/PA44 and now we see only 27 LRD's DA32/PA34? Why such a significant drop in our LRD's which I'm sure has affected everything else in the software. We checked Google Webmasters and don't see a drop in our linking URLs. We see it fluctuate all the time, but nothing like this. I'm not so much concerned with DA/PA at the moment as I know that dropped from lack of data the system can read, but why did over 60% of our LRDs disappear overnight? Anyone else seeing this happen to them? Our URL is whiteboardcreations.com
Link Explorer | | WhiteboardCreations0 -
Unable to download OSE advanced report
I started downloading an OSE advanced report yesterday. It has been over 20 hours and the message below is shown on my report list page. Processing Getting data from the LSAPI. 27,450 out of 100k results found It takes a very long time than usual so I would like to know if there is currently any technical issue on Moz part, or that I should change any setting and try downloading it from the start. Thank you very much.
Link Explorer | | iREP0 -
Any idea why ose is so slow in generating reports?
Hi Everyone, Having some real issues when I generate a report from OSE. It's external only links csv and they seem to take forever before I can download them. Is it an OSE issue or something my end? Thanks In advance Kevin
Link Explorer | | itineris_ltd0