MOZ can't find internal links on my website while Google search console finds thousands of them
-
When using open site explorer MOZ finds 0 internal links on https://www.glassesgallery.com while Google search console finds thousands of internal links. What could the issue be?
-
Here's the answer I received. I have to say, I still don't get it. On the site I manage we have internal links in the body of many articles, side widgets, footer, HTML sitemap, Related Content, and so on. Yet MOZ has us -- constantly -- at 66 internal links.
Here's the MOZ answer I received to my question about this:
I think it may help to understand a bit more about how our index is built. Our index doesn't work like a direct crawler that you'll see with Screamingfrog, or Moz Pro Site Crawl. Direct site crawlers go right to your site and crawl from page to page using links. This would give you an accurate picture of your site at the time it's crawled.
Our index is built by crawling and indexing high authority sites and pages and following links internally and externally. If we find a link to a site we may not go on to crawl and index all the other pages on that site. It's likely we won't have a complete map of all your pages and internal links.
The index and Link Explorer tool are designed to help you discover prospects to build your backlink profile, rather than give you a complete picture of your internal links. The higher your pages authority to more likely they are to be crawled and indexed.
You can learn more about our index here https://moz.com/help/guides/link-explorer/how-we-index
-
Yes having the same issue here, and support gave me the same response... You would think there support would be better for the amount you pay.
-
I'm curious about this too, but the answer above is to a whole other question. The question wasn't about backlinks, it was about internal links counted by Moz.
-
Hi, thanks for the very fast response! My main concern is that MOZ actually shows 0 (zero) internal links inside our website... I thought it to be a crawling issue but upon checking Google Search Console it quickly shows it has nothing to do with our index because Google Search Console shows them all!
So if I am to understand it correct
- Google Search Console shows ALL links no matter what the link value is of those because its spider will display ALL on our Google Search Console.
- AHRefs, like MOZ will start filtering out less valuable links but still will show more results as MOZ, yet less as Google itself because MOZ link value algorithm is matching page rank more closely so it will ignore links without page rank value.
- MOZ then is the strictest of all and will not show any links that contain no added value for the page rank / seo for that website.
So concluded from your reply I understand our internal links would start to improve once our DA reaches a significant number.
-
Hey there!
Sam from Moz's Help Team here!
This is definitely due to the way we collect this information for our link index and it is actually expected that we won’t find every page and link because we aren’t looking for them all! When we collect this data, we’re looking specifically for the most valuable links and, rather than crawling your entire site or every site, we collect this by starting our crawler on a few highest ranking sites and letting it perform a breadth first search to see what it finds.
For each page that we crawl, we first collect each of it’s links before following these and collecting the details of each page that these link to and so on. There’s a set limit of links that we’ll crawl per page and pages that we’ll crawl per site so it’s expected that we may not follow every link on your site (or any site) this way.
Open Site Explorer and the Link Analysis page of campaigns are both tied to our Mozscape index, which tends to update roughly once a month.
Just a few points on how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled ~130 billion URLs
The idea here is that we're focusing on the highest-quality links we can find, coming from the most prominent pages of authoritative sites. So, while you may not see every link for a site within our index, we're aiming to report the most valuable ones available!
Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many reasons - including the crawl-ability of sites, the number of inbound links to them, and the depth of pages in subdirectories.
You can see our most recently updated schedule here as well as some more technical metrics on our Mozscape API Updates page. You can also see when the last and next updates happened on the Open Site Explorer (OSE) homepage at any time.
Since Moz focuses on quality of links over quantity, we are always focused on the most relevant links to display to our users. It's possible that Moz's index will leave out some of the lower-quality (non-link juice providing) links out of our index because of this. So, that might explain why you may see some discrepancies with what other tools may be showing.
Generally, we recommend using a wide variety of backlink tools to get the most illustrative picture of how your site's backlink profile looks. OSE and Ahrefs index differently and have different purposes. Ahrefs is good for quantity while OSE is great for finding higher quality links. Domain Authority is our own proprietary metric that is closely correlated to Google rankings, so our customers often use OSE to research influential sites to build links.
I hope this helps - let me know if you have any further questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Inbound Links Sudden Decline
Hi,
Link Explorer | | Jane090987
There is a question of my site that the number of linking domains has experienced a sudden decline - lost inbound links for around 100k in several days.
We are wondering the reason of this sudden decline, is it a common fluctation or is there some problems in our site? Thanks for your answers in advance!0 -
MOZ DA IS NOT INCRAESING
Hey my website on business cards its DA is not increasing. is there any way to increase its DA.
Link Explorer | | cartwrightkar0 -
Moz crawling http rather than https site
Our site is secure but when I ask moz to crawl it by giving the root domain including https moz insists on crawling the non secure version. How do i force it to crawl the secure version?
Link Explorer | | media12340 -
Can MOZ keyword explorer output sentences instead keywords?
Can MOZ keyword explorer output sentences instead keywords? We need to optimize our website for the Knowledge Graph (OG). There was an old tool that does it, but I can't remember its name.
Link Explorer | | Elchanan1 -
If I have a MOZ PRO account, do I still need Screaming Frog?
Hi, I have a MOZ PRO account which is brilliant for me. I am about to move my site from HTTP to HTTPS and was looking for a smooth way to list every page and its details so I can make sure I do the correct redirects etc.. before the switch to SSL. Do I need to get Screaming Frog, or can the tools with MOZ Pro ease my path just as well? Thanks
Link Explorer | | SeoSheikh0 -
Open Site Explorer metrics report says we have 9 linking root domains, but way more than 7 are listen. What gives?
When I run a report on my website in OSE (SelectAccount" metrics tells me we have 7 "established" root domains and 9 total links. But the detailed report below has many dozens of links. What is metrics telling me?
Link Explorer | | SelectAccount0 -
What's the Story on Mozscape Updates?
Hey gang, As you may be aware, we were considerably late with our last index release. You have my sincere apologies for that and the apologies of the entire team. In the interest of transparency, I want to try to explain what's been going on. Since stepping down as CEO, I've been asked to take on a few roles in the company. One of those is product architect (basically the product owner) of our Big Data team, who produces the Mozscape link index. For several years, that team has been almost exclusively focused on getting us closer to a near real-time indexing system that does not have scalability issues. Mozscape is currently smaller than our major competitors, and we're also often slower. Our metrics (PA, DA, MozRank, MozTrust, Spam Score, Social Data, etc) have been the unique value we provide, but it's not enough. We need to be competitive on size and freshness. Building a raw link index (without processed metrics like PA/DA et al) is hard, but it's possible. Building a link index with those metrics is really tricky, and requires computer science knowledge and skills far beyond the scope of my understanding. That's what our team's been working on, and they've made some progress, but it's been slow, hampered by unknown unknowns, and materially hurt by a lack of experienced talent we can hire to help (we've had open job posts for years now). In the meantime, our historic Mozscape index structure keeps encountering challenges - this latest round is still somewhat unexplained (we believe there's hardware issues compounded by how the system is architected to handle large domains, but there may be other issues). The team's struggled to split time between keeping the old Mozscape running and hunkering down to finish the new system. I'm trying to help them balance things as best I can, and we're going to be putting effort toward making sure we get index releases out on time. However, to do that, we'll need to scale down size, and then rebuild back up. We think we can do this while also improving the prioritization of which links we crawl (e.g. deeper on important domains that link out, less so on deep pages that don't link anywhere) so the index overall improves. However, I don't want to minimize the risks - we may have some slow updates, some smaller indices, and some less-than-ideal data in the next one or two indices while we work to remedy this issue. I HOPE we don't, and that things actually get better immediately, but we can't promise that until the work gets finished. TL;DR - Mozscape V2 is in development and will let us as big and faster as any link index. In the meantime, current Mozscape's having issues & we're making smaller indices in an attempt to diagnose and repair. As always, thanks for your understanding, continued support, and if you have any questions, feel free to leave them below. I realize that this level of service/product quality is NOT OK, and I'm doing everything in my power to fix it.
Link Explorer | | randfish8 -
Repeated mysterious 404's from ancient site structure killing my rankings
Several years ago I changed my site structure to go from a flash based site to a blog based wordpress site. After doing so I went from page 1 to page 30 for my relevant search terms. I have employed people to help me track down the problem and I believe that they have narroed it to the existance of 404's being created from some unknown internal source. I have been for years getting links like this... <colgroup><col width="792"></colgroup>
Link Explorer | | dfphotographer.com
| http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/charisma-and-steve-301/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-04-2/?share=email http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-12-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/?share=facebook http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-13-2/feed/ http://www.dfphotographer.com.au/brisbaneweddingphotographer/2011/10/brisbane-wedding-photographer-charisma-and-steve-victoria-park-brisbane/photography-brisbane-16-2/?share=email | ......regularly showing in webmaster tools, (this is from a top pages report from MOZ where there are hundreds also shown). When I do a moz crawl of the site, none of these links show up. Therefore I have no way of finding the source of these links (they also do not show me the source in WMT as they should). We have completely cleared the site and rebuilt it and although it is still only a couple of weeks in it still does not appear to have stopped them. Does anyone have any way of helping me find the source of these mysterious 404's?0