OSE not picking up all internal links?
-
Hi! I've been checking a few pages in OSE. For example:
https://www.holidayhypermarket.co.uk/holidays/last-minute
This, according to the tool, has only 6 internal links. However, a Screaming Frog crawl picks up 700+, which is about right seeing as there is a link in the footer. What do you think could be behind the discrepancy?
-
Doubtful. Running a site:holidayhypermarket.co.uk search in Google returns 10,700 results, plus from the help documentation on OSE it says, "The second thing to keep in mind that the exported data will only include the top 25 pages per linking root domain," from: http://moz.com/help/guides/research-tools/open-site-explorer/top-pages-ose
So by design it's not really a tool that's trying to duplicate Google, rather make an actionable scaled down copy of what's going on.
-
Thanks. I guess my point though is if that OSE is struggling to find the links, could the search engines? These aren't buried links - they are easy to see on the page. It would be good to know if there is a glitch or if something else is going on.
-
I wouldn't use OSE as an onsite crawler. That's what a tool like Xenu Link Slueth or Screaming Frog is for.
-
Hi! I understand that OSE isn't 100% accurate, but I'm wondering if something else is going on. It picks up internal links for competitors fairly accurately. It would be good to know though why it isn't picking up the footer links - could the code be difficult to crawl etc? It may be hinting at a problem that I've missed.
-
OSE also clusters by domain, so for a given link you're not going to get near the 700+ which are internal. As a general practice OSE is great for getting at link diversity, goal setting, and seeing where the competition has gotten links in the past. It should give you plenty of ideas that way. Cheers!
-
OSE is not an end all be all for links. They only gather a certain number links and data.
You're already using screaming frog to get this data, so that should be accurate. You can also check Google Webmaster Tools, which has a section called "Internal Links".
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My link research tool is not working
Hello Dear i am facing a problem that my link research tool is not working is there any body else who has the same problem like me need help
Link Explorer | | Arenapile0 -
How is Moz DA affected by spam links? Disavow file?
So it does not appear that moz let's you upload your disavow file. So when moz calculates your DA how do spammy links factor in? After digging through our GA it appears our site was hit with the 2016 penguin update and never recovered. Our weekly visitors were 2k, then dropped to 500 and have stayed close to that level for a while. We've used the disavow tool, without success over the past 3 years. During that time we have done link out reach and built around 10 legit good quality DA links since. But we have not recovered. At this point i'm thinking I should just remove the disavow file. Moz says our spam score for our domain is 5%.
Link Explorer | | jessicapremier0 -
URL column of Link Explorer reports do not have the protocol (http or https)
I exported from Link Explorer. In the URL column, there is no protocol for each URL. Isn't the protocol part of what makes a url? I'm crawling each with http:// and https:// but it feels like this info could just be in the report. Am I missing a step?
Link Explorer | | Hyper-Dog0 -
Inbound links for https://www.example.com versus just example.com
Hi all, Wondering the difference between the Inbound Links stats for https://www.example.com versus only using example.com. When I type in the https:// version, I see 3 Spam Flags - for the example.com version, there are none. There are also spammy links pointing to the https version as opposed to the non-https version when I use this tool: https://moz.com/researchtools/ose/ Anyone know the difference and which should be regarded when fixing spam issues?
Link Explorer | | netamorphosis0 -
No back links showing in site explorer but..
I am quite surprise with this, normally site explorer show more and valid database for back links but this time its opposite. the site url is www.motortrader.com.pk webmaster shows me about 2000 where as site explorer is null. is there any particular reason for that?
Link Explorer | | Mustansar0 -
Open Site Explorer and Expired Links?
Hi guys, I've been checking a few domains for SEO purposes and it appears that OSE is indexing a lot of links which no longer exist, this has been the case for over 6 months - does OSE cleanse expired links? As I'm sure they will be contributing to authority in the eyes of Moz?
Link Explorer | | lotterybase0 -
Inbound Links Sorted by Linking Domain
Hi All -- Does anyone know if it is possible to generate a report (or is there a setting) to have the OSE inbound links report sorted by OSE linking domain? Ideally, the report would create a second column in the "Inbound Links" report with "Linking Domain" and then you could create a nice report that cross-tabbed the links. While you could do some excel text manipulation to do this, does anyone know if it's possible to do through the report generator? Thanks, Matt
Link Explorer | | Resolution_Rentals0