Opensite Explorer Not Showing Link Root Domains correctly
-
Howdy Moz friends,
In opensiteexplorer It shows my linking root domains as 45. I have been adding several new links over the past few months from various websites but my linking root domain still remains the same. In the "just discovered" tool it has been showing my links but not in the linking root domain section.
Can anyone tell me what I'm missing?
Thanks
-
Hey Thomas,
Thanks for writing in with a great question. The Mozscape index, which powers Open Site Explorer, is actually a different system than the Just Discovered Links section. Just Discovered Links specifically crawls fresh news sources and blogs to find links that were updated recently, while the data for the Mozscape index is collected by a separate crawler that can take weeks to crawl the web based on the top 10 billion URLs with the highest MozRank. The data in the main section of Open Site Explorer can be collected several weeks prior to the index update while Just Discovered Links is collected constantly. While these to data sources aren't currently integrated, we are working to integrate them in the future.
Just so you know, here's how we compile our Mozscape index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Chiaryn Miranda
Help Team Ninja
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need help fixing a duplicate content issue for my website. The moz crawl is show OMG my website with https:// and https://www. But I have never used the url https:// so I don’t understand why moz is showing this
Moz is showing my url with two different starts. Https:// and then the one I use https://www. The problem is I don’t think I have ever used the url without the www. at the start. How do I fix this?
Moz Bar | | jdp_uk0 -
Data Analysis Tool - No data found for this domain
For some reason, about a week ago, my clients website nolonger appears on the moz analysis tool ( www.movietrailersarea.org ) which it previously was. now i get the error "Bummer! No data found for this domain" and now nearly all traffic has also depleted.
Moz Bar | | Mike569
site is still indexed by google & robots isnt blocking any crawlers.
any idea?3 -
Keyword Research Using K Explorer for Company with No Competitors
Hello, I'm doing keyword research for vapementors.com I'm trying to use Moz's Keyword Explorer to do keyword research for them, but it's tough. They have no real direct competitors. I typed in a lot of related keywords in KE but couldn't find anything real high traffic. So far I have just gave them a list that I extracted from a bunch of KE results, but they rank for most of them already and there wasn't a lot of insight from my list. What do you suggest? Thanks
Moz Bar | | BobGW0 -
Keyword Explorer Stuck
Is anyone else experiencing troubles with Keyword Explorer? We have several keyword lists and they keep getting frozen on "Gathering Metrics" for days, even if we had results for those particular keywords previously. Just curious to know if this is a pervasive problem and if there's some kind of an easy fix.
Moz Bar | | hesaulsbury0 -
MozBar shows country incorrectly
My site is hosted in Reston, VA yet the MozBar shows the Canadian flag next to the URL. Does anyone know why this is happening? Screen-Shot-2016-06-16-at-9.29.07-AM.png
Moz Bar | | sbapts0 -
How to bulk check the ranking for more than 800 domains?
I got a list of 800 domains that my company owns and I want to check every domain for it's SEO value. Some of these domains where never used, but I don't know which weren't used... Do you know a tool for this? Something where I can upload the list in excel?
Moz Bar | | Becki1230 -
Big Jump in Domain Rank
We have just seen a big jump in domain rank (35 - 40) since the last update, this is also the case with the other sites we are tracking through Campaign Manager. Can anyone give me an idea what has caused this?
Moz Bar | | fraserhannah0 -
Since the revised website was launched, I can't find the "Crawl Test" function showing Titles and Descriptions of other websites. Anyone know where that link is located?
MOZ can "crawl" any website and show information like Title, Description, etc.....Can't find that link.
Moz Bar | | bpedrazas0