Open Site Explorer
-
I have entered my site (patioenjoyment.com) a few different times into the OSE and it never seems to find it, MOZ has found it because it has done the crawl test for me a few times, found some issues and I have been working on those. But I assume that if it is able crawl my site it should find it to run the OSE. It has come back with "**It looks like we haven't discovered established link data for this URL yet." everytime. **
Thanks,
Julie
-
Hey Julie,
Thanks for writing in and sorry for the confusion. Our link index is not created using our crawl test or campaign crawls of a site. The index is actually a completely separate database compiled by crawling the web and following the links we find there. Your site will only be included in Open Site Explorer if we find links to your site from outside sources.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
As Pixelbypixel mentioned, Majestic SEO and Ahrefs often have a larger index than we do because their tools are exclusively focused on links, while we have a wide variety of tools with an overview of a site rather than on one specific aspect of SEO or marketing.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
Help Team Ninja -
Hi Julie,
Rogerbot isn't as big as other bots so it takes him a little while to get about. did you make sure you gave him enough time?
Now if you really need to you can also try other sites like Majestic SEO & ahrefs to find links but again they will also need a bit of time (though i tend to find them a bit faster than OSE). Other things to remember is the more you links to a page the easier it is for it to be crawled so if you don't have any links on it it can take a bit longer too.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz link explorer is how much reliable and accurate as compared to others link explorer tools like Ahref
Hi.. I need to check backlinks for one of my client website duplicatebills through Moz Pro link explorer tool then its show that linking domain to this website are 90 but when i cross check these links from other tools like Ahref free backlinking tool then its show a different figure (ahref show that linking domain to this website are 103).
Link Explorer | | dbills
I am confused that which one correct. And MOZ link explorer tools in reliable to which extent?0 -
How Do You Deal With Duplicate Content On A Retail Site
Hi Guys We make custom portfolios and boxes and every time we have a Moz site crawl, Rogerbot always returns a number of Duplicate Content Issues relating to different products. As per the image below (which I hope is visible?!) Rogerbot has flagged duplicate content onto one product that relates to 5 other different products. For instance there is duplicate content for an A4 Leather Portfolio and an A3 Leather Portfolio and an 11"x17" Leather Portfolio. I can't redirect or canonicalise to just the A4 Portfolio as they are all individually different products. The information on each page although similar, is relevant to each of the products, so rewriting a different blurb on each product page, will not be user friendly for our customers. I could ignore the duplicate content issues, but then that isn't good practise (and also makes for a very unsatisfactory looking Dashboard!) Any ideas?? Nick wzQLgBl
Link Explorer | | nick_HandCo1 -
Exportable Bulk PA Analysis for Entire Site?
Is there a way to run a report through Moz's Open Site Explorer to produce an MS Excel or Google Sheets spreadsheet showing Page Authority (PA) for all the individual pages on my site?
Link Explorer | | micromano0 -
Site moved to https and not showing any Moz DA or PA
Hello Fellow Mozzers, So, I have a client site that we moved from non https to https at the end of 2015. We had decent moz numbers (Da/Pa etc) but now we are only showing a 1 for both of them. Does it usually take time for Moz to carry over the info to the https version or does that process entirely start over? Not sure where to start looking. Cheers D
Link Explorer | | DarinPirkey0 -
Twitter Data Does Not Appear in Open Site Explorer
Hi, I ran a search of more than 10 of my competitors in Open Site Explorer to have insights on their social activity. In every case I found "NA" marked against Twitter data. Does it mean there is no activity being performed by the urls against which i am running the query? Or it is something else? Wondering since there is much activity and data of course against Facebook and Google+ (same urls yeh!) Anybody could find time to share her/his knowledge please. Regards Tanveer
Link Explorer | | Sequelmed0 -
Is this site linking to us?
Hi, Moz OSE does not recognize this site as linking to our site, but I feel like it has to be. Here is the code and the link to the site: http://www.avvo.com/attorneys/34655-fl-stacy-kemp-1843513.html#contact [https://kemprugegreen.com/location/tampa/tampa-car-auto-accident-attorney/](<a class=)" target="_blank">https://kemprugegreen.com/location/tampa/tampa-car-auto-accident-attorney/ So are they linking to us? If so, how come OSE cant find it? It lists it for our competitors. Thanks, Ruben
Link Explorer | | KempRugeLawGroup0 -
Removing the clutter of site-wide links
I have a multi-part question with regard to the moz link index and some presentation suggestions. Firstly I would be interested to know how the link index treats site-wide links with regard to metrics such as DA, and PA. We all know that it is highly likely that SE's are unlikely to pass full link value across from sitewide links, and therefore it would make sense for Moz values to account for this as well - if they do not already. One annoying thing that also relates to sitewides is that they tend to clutter the much of the information presentation in a few of the tools (you can't see wood for trees as it were). This is most prominent in the "Just Discovered" page - if you have a sitewides on a large site, you can often find that this screen is just totally filled with these links as they are found. It would be very useful to be able to filter these out, as they are of little interest - currently I can't see a way of filtering them out. A further value where they create to much noise is the 'Total Links' value. Where sitewides are included in this value, the value actually becomes pretty meaningless as you can find that the majority of that value is sitewides. It would therefore be useful if there was another value for 'Total Links - Excluding Sitewides' where maybe value of 1 was just added to the count for a site wide
Link Explorer | | James770 -
Is there an option that's more precise over Open Site Explorer?
I've had folks explain to me before that OpenSiteExplorer is just an estimation, etc. but there are some fairly easy statistics that seem to be different and it makes me nervous that either its wrong or I'm doing something wrong. As you can see in the image, moz isn't read social metrics correctly. It actually used to be pretty spot on, but as you can see with Google+'s its off. Maybe not a big deal right? But for my clients new Moz Analytic print outs it makes somewhat of a difference. Any help? UlwQs3w
Link Explorer | | jonnyholt0