Specific external links
-
So...we have an A+ rating with the BBB and have for some time. We have a link from their page. We also use sites like pricegrabber and reseller rankings and have links from those.
What I can't figure out is why links from the BBB and Pricegrabber don't even show up in open site explorer but the reseller ratings links are everywhere. The BBB one is easily the oldest and the other two are roughly the same age (i.e. at least a couple years old.)
-
The Open Site Explorer indexed is completely refreshed every few weeks, and currently consists of 105 billion links. While that's quite a large data set and mostly comparable with other indexes in the space, it's still only a fraction of the links on the web and only a portion of the links Google undoubtedly knows about.
The way OSE finds links is that it prioritizes pages with lots of inbound links and links it found during previous crawls. Because BBB pages are often found deep-deep-deep under layers of navigation and usually don't have a lot of external links pointing to them, they aren't easy pages for crawlers to find on a regular basis. BBB has an especially difficult site architecture, and sadly this issue comes up a lot with that particular site
We're working on including more historical data in the index, so that even if we didn't crawl the link in the past two weeks, we'll still include it if we are reasonably confident it still exist. This will help alleviate some of these concerns.
The good news (or bad depending on how you look at it) is that while OSE doesn't show every link, it tends to show the majority of the most valuable links.
Regardless, thanks for the feedback and best of luck with your SEO.
-
I share your frustration in wanting to be able to track links in OSE. Someone at Moz told me a while back that OSE only reaches 20-25% of links out there. I've just come to tell myself that if I know the link exists then I don't need to see it in OSE.
-
I wonder if Moz understands and follows the Robots.txt file? I know at one point they never, back in the day when I used Moz most of my errors came from URL's which were hidden by robots which would not of caused errors for Google.
& what your saying Oren makes perfect sense if it's correct. Why would they want to crawl aggregated content.
-
Perhaps a Mozzer can verify this, but I remember someone saying they Moz doesn't crawl some big sites that aggregate lots of data (twitter, BBB, yelp, domain listings, etc. etc.) because of the size of their servers, and the likelihood that the user put it there themselves. They have smaller servers than say, Google or Bing.
-
Hi,
Firstly it could be that Open Site Explorer has not had time to pick them up, if it's years old then let's not forget the OSE manually crawls the internet and is not Google's crawler meaning there will be sections of the web which won't be crawled by Moz.
If it's old then there may be no links pointing to these pages which would not give OSE a reason to crawl them, certainly if it's years. Don't worry about it, a missing link on OSE is one less your competitors can find I had a similar issue with a few links from BOTW but in time it updated and works fine but Open Site Explorer is not flawless.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate pages coming from links from the login page - what should we do about them?
This is a follow on to an earlier question which was well answered by Dirk Ceuppens regarding abnormal crawl issues. We are seeing that the issues relating to Duplicate Pages are coming from links from the login page which shows information about where the user was redirected from. For example, if the visitor is not logged on and wishes to wish-list an item, they will be redirected to the login page, with the item code and intended action in the url; which can then continue on to the desired page once logged on. The MOZ crawler is seeing these pages as having Duplicated Content whilst they are all the same apart from a piece of information in the URL. Should we be blocking these duplications? Are they a risk to us? What should we be doing? Many thanks, Sarah
Moz Pro | | Mutatio_Digital0 -
Why did my DA and Links go down?
How could I begin to research this to find out why we have less total links and a lower domain authority. Our DA has gone down two points and our total links dropped by a few thousand. I'd like to find out why that happened but I'm just not sure where to start. Thanks!
Moz Pro | | Sika220 -
Can I password protect specific campaigns
I would like for client A to access its online reports directly wihout access to other client campaigns. Is it possible to add some additional campaign specific password protection?
Moz Pro | | worldviewpr0 -
Compare link metrics - What time frame is this in?
Hi, I'm comparing three sites and one of them I know is quite popular however a few of the social statistics are puzzling me; they've got a small amount of Facebook likes and times shared on twitter - Which just can't be right if it's all time. What's the time frame of this data? The last three months or? Thanks, Dan
Moz Pro | | Sparkstone0 -
Links & page authority crawl
I see the links and page authority have not been updated in over a month... does anyone know how often it gets updated?
Moz Pro | | nazmiyal0 -
Is it possible to create a report where per page only external links are shown?
Hi all, When I create a report on page level (links to pages per page), it seems that also internal links are included. Is it possible to create a report where per page only external links are shown? thnx Dennis
Moz Pro | | djingel10 -
Should I worry about limiting link count on product listing/category pages?
I've noticed that my link count is high (165ish for some) on my category listing pages. I've been scouring my page to see if there's any way that I can reduce the link count without restricting functionality to the end user. Each product listing on the category page has 5 links currently: A link to the product in the title A link to the product from the image An 'add to compare' link An 'add to cart' link An 'add to wishlist' link When the customer chooses to show 30 products per page, the link tally goes off the scale. So I have two questions: Firstly - is it appropriate to keep link count down in this scenario? To elaborate - is it just inevitable that product listing pages will have lots of links, and should I just assume that Google knows this and forget about these warnings. Secondly - There are two links to the same page (the title and image links to the product page). Does SEOmoz include this in the link count, and more importantly, will Google take heed of these when deciding whether the page is too link-heavy?
Moz Pro | | SimonGreer0 -
Missing back links in Open Site Explorer?
I'm looking at the Open Site Explorer for my site, and it shows 9 links to my site, all from 2 domains (showing all links from all pages and for both www and not www version of my domain name). But I know for sure that there are other sites linking to my site. Are they not there because they are not important or because the links have not been crawled yet?
Moz Pro | | jsoldi0