Crawling and Links - Showing Links
-
Hello
I have a campaign in Moz that shows a new site as having no domain authority and no links.
The site does have links to it, but they don't show up on OSE.
Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link.
What is the best way to see the links the site has?
Thanks!
-
Hey Radi,
The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
Just so you know, here's how we compile our index:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
- We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.
We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.
Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why moz is not indexing link from 21 march any body knows
I have lot of website few of them are really big sites. i want to know Why moz is not indexing link from 21 march any body knows please let me. is there some kind of maintenance going on
Link Explorer | | Arenapile3210 -
I build DA from 15 to 26 in 45 days, but now it stop. We have links from 50+ high authority websites and building more.
Hi Team I build my website domain authority from 15 to 26 points in the last 2 months. We getting links from high DA traffic websites all across the globe through guest posting. We grow from 34 linking domains to 155 in this duration(45days) and still, we are working on getting quality links through authority websites. My DA stops on 26 which is not growing for last 2 weeks. Please share your views on it. Thanks in advance
Link Explorer | | AtulSharan1 -
Follow tag is showing no follow in site explorer
I have a link which is showing tag as a follow but in Moz site explorer is showing no follow link here is the link - https://www.techtimes.com/articles/237876/20190125/top-5-best-instant-messenger-businesses-2019.htm Could anyone here tell why this is happening
Link Explorer | | TvishaTechnologies0 -
Just Discovered Links Are Down for ~2-3 Days
UPDATE 12/01/15: This issue is now resolved and Just Discovered Link data is back. Sadly, I've got bad news. Due to an error we made (literally a typo on a curl command), Just Discovered Links in Open Site Explorer will be unavailable for 2-3 days. The data was actually lost, but we're re-indexing all those links now and they should be back in working order by Monday. NOTE: this only affects link counts and links listed in the "Just Discovered" sections of OSE. No links in the main index nor any metrics (PA/DA/etc) are affected. Our sincere apologies - we're going to build mechanisms to prevent this for the future.
Link Explorer | | randfish3 -
Is this site linking to us?
Hi, Moz OSE does not recognize this site as linking to our site, but I feel like it has to be. Here is the code and the link to the site: http://www.avvo.com/attorneys/34655-fl-stacy-kemp-1843513.html#contact [https://kemprugegreen.com/location/tampa/tampa-car-auto-accident-attorney/](<a class=)" target="_blank">https://kemprugegreen.com/location/tampa/tampa-car-auto-accident-attorney/ So are they linking to us? If so, how come OSE cant find it? It lists it for our competitors. Thanks, Ruben
Link Explorer | | KempRugeLawGroup0 -
Internal links - OpenSiteExplorer vs Webmaster tools
Hi guys, I run Opensiteexplorer on the website www.fazland.com (in italian...). (https://moz.com/researchtools/ose/comparisons?site=www.fazland.com) It only shows ca 240 internal links where I know there are plenty more also shown in Google Webmaster Tools. I cannot figure out why it can crawl so few links - Google shows 79.000 links found and internal links are pretty well established. Any suggestions from your experience on this difference? Cheers, Rob
Link Explorer | | r.bonsanti0 -
Difference between Link Analysis and open site explorer
Hey, when i check my links in Link Analysis in Moz Analytics is see 45 Linking Root Domains. The manual states: " If you want to look at these pages in more depth, just click the export button. This will take you to Open Site Explorer so you can dig deeper into your link profile and export the data for review later." But when i go there, the open site explorer states i only have 31 Linking Domains. What could explain the difference?
Link Explorer | | RoderickG0 -
Duplicated content detected with MOZ crawl with canonical applied
Hi there! I have a slight problem.
Link Explorer | | Eurasmus.com
I have a site with Joomla 3.3 that we recently migrated from 2.5. Joomla, for some reason that I don´t really get, creates hundreds of weird urls for the site like
mydomain.com/en -> joomla creates en/home/149-xxx-xxx/xxxxxx-xxxxxx that links to the first one.
The new version 3.3 knows this bug and applies a rel=canonical to the ones created "artificially", so they should not be identified as duplicated. Sample piece of code: en/home/149-all-en/xxxxxxx-xxxxxx" rel="canonical" / MOZ crawler identifies this as duplicated and like this I have thousands of pages duplicated all with titles, content etc... all the ones created by joomla. Still my site has good SEO results and I can not see any penalties but I am a bit concerned they may come in the future.... Can anyone explain me what is happening? Thank you in advance for your time,0