OSE not picking up all internal links?
-
Hi! I've been checking a few pages in OSE. For example:
https://www.holidayhypermarket.co.uk/holidays/last-minute
This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
-
Doubtful. Running a site:holidayhypermarket.co.uk search in Google returns 10,700 results, plus from the help documentation on OSE it says, "The second thing to keep in mind that the exported data will only include the top 25 pages per linking root domain," from: http://moz.com/help/guides/research-tools/open-site-explorer/top-pages-ose
So by design it's not really a tool that's trying to duplicate Google, rather make an actionable scaled down copy of what's going on.
-
Thanks. I guess my point though is if that OSE is struggling to find the links, could the search engines? These aren't buried links - they are easy to see on the page. It would be good to know if there is a glitch or if something else is going on.
-
I wouldn't use OSE as an onsite crawler. That's what a tool like Xenu Link Slueth or Screaming Frog is for.
-
Hi! I understand that OSE isn't 100% accurate, but I'm wondering if something else is going on. It picks up internal links for competitors fairly accurately. It would be good to know though why it isn't picking up the footer links - could the code be difficult to crawl etc? It may be hinting at a problem that I've missed.
-
OSE also clusters by domain, so for a given link you're not going to get near the 700+ which are internal. As a general practice OSE is great for getting at link diversity, goal setting, and seeing where the competition has gotten links in the past. It should give you plenty of ideas that way. Cheers!
-
OSE is not an end all be all for links. They only gather a certain number links and data.
You're already using screaming frog to get this data, so that should be accurate. You can also check Google Webmaster Tools, which has a section called "Internal Links".
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved learning about links...
Hello! I'm wanting to gain some insight about backlinks, and wondering why a client's digital ads don't count towards our external link count. We don't see the domain listed in the Linking Domains and were just curious. Any information would be appreciated as we're always trying to learn! Thanks!
Link Explorer | | Ebbeka0 -
Why is Link Explorer showing the same domain strength for domain and sub-domain? Shouldn't it be different?
I believe in the past the sub-domain score was different than the domain score in Link Explorer. Now I am seeing that it is reporting the same score. I have to use exact page to get a sense of how strong the sub-domain is.
Link Explorer | | Liamis0 -
How do you check for .gov and .edu backlinks using the new link explorer?
I'm trying to do an audit but I can't seem to figure out how to find .edu and .gov backlinks from the new link explorer. Can someone please help? I'm trying to learn how as open site explorer will be replaced by the link explorer. Thank you!
Link Explorer | | AFARiva1 -
Crawling and Links - Showing Links
Hello I have a campaign in Moz that shows a new site as having no domain authority and no links. The site does have links to it, but they don't show up on OSE. Does Moz count links in the comments section of blogs (or is this counted as social, when the commenting system is one that requires facebook login?) I know blog comments are not great for SEO, I just use them when the post/link is 100% genuinely relevant. The site does have actual links on websites not just comment links, so it isn't showing any type of link. What is the best way to see the links the site has? Thanks!
Link Explorer | | wearehappymedia1 -
Why is OSE showing a higher Domain Authority than Moz?
Moz has today run monthly reports for 2 of my clients' sites. For both of these, the Domain Authority reported on the Moz dashboard is several points lower than that shown by OSE today for the same sites. Why would that be?
Link Explorer | | mfrgolfgti0 -
Why are no-follow links in my blog comments across the web showing up as "equity-passing"?
When I make comments on blog posts (and there's a link in my comment or my name is the link to my site), the links are always no-follow (as they should be). But, when I check Open Site Explorer, the new links show up as equity-passing. Are they actually passing equity or is this a mistake?
Link Explorer | | infotrust20 -
OSE results vs. Google
Is OSE still a worthy analyzer of the factors breaking down Google rank of a page or website? More so over the past six months, I've seems to noticed how the page comparison in OSE seems to have less and less correspondence to Google rank. For instance, I'm analyzing sites where the top result has a Page Authority rank of 11, Subdomain MozRank of 3.53, outranking a page coming in in spot #14 with Page Authority of 36, Subdomain MozRank of 3.94. I see this frequently, that by the factors measured in OSE, a certain page with favorable scores is being outranked by a page with poor OSE scores. Of course, I realize how sophisticated Google's algorithm is and the OSE can't reverse engineer the whole thing. Also, there are lots of other factors, such as personalized search results, banklink velocity, and who's in my G+ circles, that isn't taken into account in OSE. Yet, I see this more-and-more, where websites kicking ass in OSE measurements rank poor, and poor websites ranked in OSE come out near the top in Google. So, given this, where OSE is apparently a less effective tool to help analyze the factors building Google rank as Google evolves and values brand, what should a chap do? I already know the predictable answers of do RCS, build your community, and so on. But, I want to know what's driving the juice behind these top ranking websites, and OSE doesn't seem to be cutting it anymore... Your thoughts?
Link Explorer | | ExploreConsulting0
