Opensite Explorer Not Showing Link Root Domains correctly
-
Howdy Moz friends,
In opensiteexplorer It shows my linking root domains as 45. I have been adding several new links over the past few months from various websites but my linking root domain still remains the same. In the "just discovered" tool it has been showing my links but not in the linking root domain section.
Can anyone tell me what I'm missing?
Thanks
-
Hey Thomas,
Thanks for writing in with a great question. The Mozscape index, which powers Open Site Explorer, is actually a different system than the Just Discovered Links section. Just Discovered Links specifically crawls fresh news sources and blogs to find links that were updated recently, while the data for the Mozscape index is collected by a separate crawler that can take weeks to crawl the web based on the top 10 billion URLs with the highest MozRank. The data in the main section of Open Site Explorer can be collected several weeks prior to the index update while Just Discovered Links is collected constantly. While these to data sources aren't currently integrated, we are working to integrate them in the future.
Just so you know, here's how we compile our Mozscape index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Chiaryn Miranda
Help Team Ninja
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
After adding a new page to optimization section it shows up as dashes
After adding a page to the optimization section, it doesn't put the score, title, or ranking on. It shows up as dashes After adding a new page to the optimization section it shows me my score. I go back to the home page of the optimization section to see it's ranking and all the details are dashes. Like the moz score, the ranking, and the title. It has only been happening recently. What am I doing wrong?
Moz Bar | | leannegoff0 -
Puzzled. High domain authority, but low page authority?
I have a question regarding how a page's authority can be low but the domain authority be high. I'm using the SERP report in moz to compare competing pages. The page I'm working on is an ecommerce category page. Moz says it has very low page authority, has been indexed for a little over a year, it's domain authority is a moderate 50, and has no root domains linking to it. It is more relevant than the other pages (has more products for sale that fit the keyword searched for), has a decent amount of copy on the page, but ranks around #10 in the search results. The competing pages are also ecommerce category pages. The 9 ranking higher have domain authority varying from 30-75, and 1 or 2 root domain links to them. Their number of products that match the keyword searched are all over the board, some have many matches, some have only 6 or 8 results. Some have a moderate amount of text on the page, some have very little text on the page. Yet they have page authority in the 30s-40s. What goes into page authority that I'm missing which would make these other pages have so much more authority when they are just slightly better in the other metrics listed above? What am I missing here?
Moz Bar | | K-WINTER0 -
I update content and then craw but the MOZ spider still shows old content. Do I need to update something else?
"This shows but was replaced a day before I ran Moz crawer: | We provide a full service for low cost automated phone calls, robocalls, Bulk SMS service, Political robo calls without needing computer skills | "
Moz Bar | | ThomasDaBomb
I look in the link on website and see:
<title>Our customers talk about: Currently the tremendous growth of organi</title> Why does the craw not reflect the current content? Thanks.
Thomas0 -
Ww.domain.com coming up with error
our domain is showing in moz with the following error in crawl reports Crawl Error We were unable to access your homepage, which prevented us from crawling the rest of your site. It is likely that other browsers as well as search engines may encounter this problem and abort their sessions. This could be a temporary outage, but we recommend making sure your network and server are working correctly. note that the url being displayed is ww.domain.com and not www.domain.com . we do not have a 301 in place, we have switched off wildcard forwarding from the server.. its acting as the url is a subdomain that is not working.. should i just ignore it?
Moz Bar | | Direct_Ram0 -
Link Acquisition Assistant
I understand directories are of less value these days. However, as a portion of your link profile are you finding benefit from directories discovered through the Link Assistant? This is all under the assumption you also have great a great value prop and content etc. Thank you!
Moz Bar | | Element-3600 -
How to get Universal Results to Show in Reports?
This has been a source of frustration for me for a long time. I have asked many times and never found anything in the support documentation on how to add this. Is it something that is simply not offered? If so is it not outrageous to others that this simple feature is not present? What I want: I would like to be able to include Universal Results icons in my rank reports. Why? Well as is the case much of the time my clients Google profile is included in the maps results (thanks to our optimization services) but they are not on the first page. The client can't see the results of this type of SEO. It shows up when logged in but not in the exported reports. How easy would it be to include these? It seems like a no-brainer. If anyone knows where to add them or why they don't automatically include them please let me know. If this feature is not offered I call upon my fellow SEO's to demand this feature. If anyone knows of a way to contact the developers to recommend adding this feature I would also appreciate that information. Thank you Universal Result: Local
Moz Bar | | TotalMarketExposure
You're in it!
Position: before 1st natural result
Contains: 7 results0 -
Pinterest Back Links Showing For One Website But Not Other in OSE
Hello, I have verified my business websites on both of my pinterest accounts for the following websites Http://www.prickettproperties.com and Http://www.ChicFamilyTravels.com The backlinks for prickett shows up in OSE, but not for ChicFamily. I am curious as to why that is? Thanks in advance for your help
Moz Bar | | Prickett0 -
Mozbar showing 0 links for pages in the main nav.
I'm working on a site where the mozbar is showing 0 links for every page in the main nav menu but home. A crawl of the site isn't showing any issues with blocked or nofollowed meta robots. Is this simply a bug in mozbar? What else could be causing this? If this is a problem with on page seo what is the solution?
Moz Bar | | Kairos_Internet_Marketing0