Specific external links
-
So...we have an A+ rating with the BBB and have for some time. We have a link from their page. We also use sites like pricegrabber and reseller rankings and have links from those.
What I can't figure out is why links from the BBB and Pricegrabber don't even show up in open site explorer but the reseller ratings links are everywhere. The BBB one is easily the oldest and the other two are roughly the same age (i.e. at least a couple years old.)
-
The Open Site Explorer indexed is completely refreshed every few weeks, and currently consists of 105 billion links. While that's quite a large data set and mostly comparable with other indexes in the space, it's still only a fraction of the links on the web and only a portion of the links Google undoubtedly knows about.
The way OSE finds links is that it prioritizes pages with lots of inbound links and links it found during previous crawls. Because BBB pages are often found deep-deep-deep under layers of navigation and usually don't have a lot of external links pointing to them, they aren't easy pages for crawlers to find on a regular basis. BBB has an especially difficult site architecture, and sadly this issue comes up a lot with that particular site
We're working on including more historical data in the index, so that even if we didn't crawl the link in the past two weeks, we'll still include it if we are reasonably confident it still exist. This will help alleviate some of these concerns.
The good news (or bad depending on how you look at it) is that while OSE doesn't show every link, it tends to show the majority of the most valuable links.
Regardless, thanks for the feedback and best of luck with your SEO.
-
I share your frustration in wanting to be able to track links in OSE. Someone at Moz told me a while back that OSE only reaches 20-25% of links out there. I've just come to tell myself that if I know the link exists then I don't need to see it in OSE.
-
I wonder if Moz understands and follows the Robots.txt file? I know at one point they never, back in the day when I used Moz most of my errors came from URL's which were hidden by robots which would not of caused errors for Google.
& what your saying Oren makes perfect sense if it's correct. Why would they want to crawl aggregated content.
-
Perhaps a Mozzer can verify this, but I remember someone saying they Moz doesn't crawl some big sites that aggregate lots of data (twitter, BBB, yelp, domain listings, etc. etc.) because of the size of their servers, and the likelihood that the user put it there themselves. They have smaller servers than say, Google or Bing.
-
Hi,
Firstly it could be that Open Site Explorer has not had time to pick them up, if it's years old then let's not forget the OSE manually crawls the internet and is not Google's crawler meaning there will be sections of the web which won't be crawled by Moz.
If it's old then there may be no links pointing to these pages which would not give OSE a reason to crawl them, certainly if it's years. Don't worry about it, a missing link on OSE is one less your competitors can find I had a similar issue with a few links from BOTW but in time it updated and works fine but Open Site Explorer is not flawless.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links don't show in MOZ
Hi, Im have started some weeks ago with some standard linkbuilding from websites to my domain www.eppinga.nl . These links don't show in Moz. Does this take some time? How long does it take? Thanks in advance for all replies! Tymen
Moz Pro | | Tymen0 -
DA as a measure of link-building success/failure?
Hi all 😃 What would be a good way to track weather a website is doing good or bad in regards to link-building in google's eyes? Is the Domain Authority the best credential? If a website is penalized for link-building schemes, would it reflect on the Domain Authority shown in Moz Analytics? What other Moz score would reflect this scenario? Best regards & Thank you for your help. Carlos
Moz Pro | | 90miLLA0 -
No follow links also been reported in SEOmoz crawl diagnostics
Hi, Why does SEOmoz reports links which has been marked as 'nofollow'. I am getting 'Overly-Dynamic URL' reports on links which I have designated as nofollow which means Google will discount them. So why does SEOmoz still report them. Thanks.
Moz Pro | | malpani0 -
How can I increase the number of links downloaded with the Opensite Explorer Just-Discovered tool?
I recently just tried to download the list from the OpenSite Explorer Just-Discovered tool and it only downloaded 233 links. When I checked to see how many URLs were available it was over 4,000. It does seem as though it only downloaded today's links although I'm not quite sure about that. Is there a way to increase the number of links downloaded to match what is listed in Opensite Explorer? Thanks.
Moz Pro | | searchysearchy0 -
Competitive Link Analysis not showing links.
Hate asking such a vague question, but my SEOMoz link analysis report is not showing any backlinks for a client of mine. I loaded the information the same way I did my other clients, which show all links. www.domain.com is being forwarded properly to domain.com. I know there are backlinks because I put many of them there myself over the last couple of months. Clearly this is affecting my Moz score. Not sure how to troubleshoot this. Can anyone offer suggestions? Grazie mille! Regards, Dino
Moz Pro | | Dino640 -
How reliable are the external link metrics found in the Open Site Explorer research tool?
I have noticed huge discrepancies with the external link metrics of one of the websites that I have been tracking since the launch of the website. Shortly after launch I captured a screenshot of the external link metrics to the website to track the progress. As I look at the same Open Site Explorer metrics now (2 months later) it has increased by 900% which is very inconsistent with the amount of link building done for the client. Thanks!
Moz Pro | | michaeleagar0 -
OSE lists dead links
Going over the link profile of a competitor who gets 5x the traffic we do.... of course frustrated that the majority of their links are spam blogs (full of words but don't communicate anything) and forum profiles. Thanks Google for telling me what not to do, then rewarding my competitor for doing it shamelessly. Question regarding sites listed by Open Site Explorer as linking to said competitor, but that don't even load when I visit their url. Some go to a godaddy parked page, like the domain name expired long ago. Is this simply a limitation of OSE, and can I assume Google has indexed differently and therefore awarding no link juice from these urls?
Moz Pro | | jotham20 -
Forum posting link building
Is answering questions on yahoo answers and forums genuine link building opportunity? I dont mean spamming much, but being a genuine member of the forums
Moz Pro | | CompleteOffice0