Specific external links
-
So...we have an A+ rating with the BBB and have for some time. We have a link from their page. We also use sites like pricegrabber and reseller rankings and have links from those.
What I can't figure out is why links from the BBB and Pricegrabber don't even show up in open site explorer but the reseller ratings links are everywhere. The BBB one is easily the oldest and the other two are roughly the same age (i.e. at least a couple years old.)
-
The Open Site Explorer indexed is completely refreshed every few weeks, and currently consists of 105 billion links. While that's quite a large data set and mostly comparable with other indexes in the space, it's still only a fraction of the links on the web and only a portion of the links Google undoubtedly knows about.
The way OSE finds links is that it prioritizes pages with lots of inbound links and links it found during previous crawls. Because BBB pages are often found deep-deep-deep under layers of navigation and usually don't have a lot of external links pointing to them, they aren't easy pages for crawlers to find on a regular basis. BBB has an especially difficult site architecture, and sadly this issue comes up a lot with that particular site
We're working on including more historical data in the index, so that even if we didn't crawl the link in the past two weeks, we'll still include it if we are reasonably confident it still exist. This will help alleviate some of these concerns.
The good news (or bad depending on how you look at it) is that while OSE doesn't show every link, it tends to show the majority of the most valuable links.
Regardless, thanks for the feedback and best of luck with your SEO.
-
I share your frustration in wanting to be able to track links in OSE. Someone at Moz told me a while back that OSE only reaches 20-25% of links out there. I've just come to tell myself that if I know the link exists then I don't need to see it in OSE.
-
I wonder if Moz understands and follows the Robots.txt file? I know at one point they never, back in the day when I used Moz most of my errors came from URL's which were hidden by robots which would not of caused errors for Google.
& what your saying Oren makes perfect sense if it's correct. Why would they want to crawl aggregated content.
-
Perhaps a Mozzer can verify this, but I remember someone saying they Moz doesn't crawl some big sites that aggregate lots of data (twitter, BBB, yelp, domain listings, etc. etc.) because of the size of their servers, and the likelihood that the user put it there themselves. They have smaller servers than say, Google or Bing.
-
Hi,
Firstly it could be that Open Site Explorer has not had time to pick them up, if it's years old then let's not forget the OSE manually crawls the internet and is not Google's crawler meaning there will be sections of the web which won't be crawled by Moz.
If it's old then there may be no links pointing to these pages which would not give OSE a reason to crawl them, certainly if it's years. Don't worry about it, a missing link on OSE is one less your competitors can find I had a similar issue with a few links from BOTW but in time it updated and works fine but Open Site Explorer is not flawless.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO for e-commerce, linking, brand mentions, insights diagnostics
Hi, I run the seo for www.bilthamber.com It is an e-commerce site selling car care products, and we also manufacture our own products. I was wondering how the seo for an e-commerce site might compare to the seo for a blog or information based site, or other types of site. And also how the seo for a particular product page on my site might compare to a information based page on my site. Are the tactics the same? Should you try and rank for similar terms, the same generic terms, or complelty unique terms for the best seo? Or should every page try and rank for different terms, to ensure that the engines dont rank 2 or more different pages for the same search term? And how many keywords or search terms should I try and rank a particular product page for? Or an information page, or blog page? Is there a minimum or maximum that is recommomended? Does the more terms you try and rank for on a page take the weight out of each of them? So having 4 really good search terms might be better than having 10 ok generic ones? How do I find out what are my best, most highly converting, most profitable keywords overtime for Google? I can find some information like this, but it is showing the stats for Bing UK, not Google, even though Google UK is my main engine in Moz. My domain authority has decreased by 3 this week, this is the first time it has gone down since I started with Moz a few months back, can anyone explain why? And how this will affect the rankings ect, and how I can get it back up higher agian? And for linking and brand mentions, what are the goals of this feature? Should I find my mentions and ask them to talk about us more and link to us properly? I'm not sure if this is right. Should I be asking other websites to make links to our pages, or should it be organic? And for the insights section, I am recieveing tons of issues a lot to do with duplicate content, will having the rel=carnocial tag fix these issues? I know thats a lot for 1 question, but its been building up in my head! Thanks in advance! Max
Moz Pro | | BiltHamber10 -
Reclaim lost links to old pages?
We recently moved our site to a new CMS and did a complete redesign, with new content. It's really hit our SEO. Open site explorer is telling me there are lots of 404 web pages which were basically old product pages that no longer exist, since the way we have structured the site has changed. So is it worth trying to reclaim these links? If so, how can I do that without building pages at the URL - will a 301 redirect be enough?
Moz Pro | | jbritchford0 -
Total External Links
Hi There, I'm looking at my link profile and my Total External Links dropped uber dramatically back in April. Any way to figure out what the heck happened? My only idea is that this was around the time we launched a new version of the website but I'm not sure it corresponds exactly and anyway the domain didn't change. Possibly some urls did but all have been redirected. Any ideas? Thanks, site is www.nationalpardon.org
Moz Pro | | NationalPardon0 -
Internal Links Data on OSE and poor ranking despite excellent metrics
Hi folks, I use OSE a lot for comparing where we stand against our competitors and I'm always surprised to see most of our competitors have loads more internal links than we do. For example, comparing 'www.kensyard.co.uk' with 'www.sterlingbuild.co.uk', we are better on every Root Domain Metric except for the Total Links metric and this is down to a much smaller number of internal links. They are ranking better than us in Google so I'm wondering if there is something wrong with the way our site is coded / structured that means Google and OSE are not picking up our internal link network properly? We have over nine times as many external root domains linking to our site than theirs, which is surely a far more valuable metric than internal links right? Or is there an issue with our internal link structure that is confusing Google and causing us to rank lower? Many thanks for any advice, Luke
Moz Pro | | LukeyB300 -
Finding affiliate links with opensiteexplorer
Hey guys, I'm trying to develop lists of our competitors affiliates using opensiteexplorer using the following method When logged in to seomoz, go to http://www.opensiteexplorer.org/ Search for<rival company="" domain=""></rival> Select Show ALL links from ALL pages to PAGES ON THIS ROOT DOMAIN and SHOW LINKS UNGROUPED Click 'Filter' Click_ 'Download csv'_ Open the csv in excel and filter the Target URL column for any known part of the affiliate link (example ?a_aid) - this leaves you with a list of the affiliate links Filter out duplicates Is this the best process? I have a feeling I'm missing some as OSE truncates to 25 links per domain. It would be nice also if OSE could do the filtering for me. Any better ways to do this?
Moz Pro | | pilkster2 -
Percentage of good links vs. bad
Hi Does anyone know the best way of determining good links from bad links using the SEO Moz tools? I bought some directory links to two or three pages on my site a few years back. The were all very obviously spammy because of the anchor text and I didn't have a high enough ratio of good links to counteract them. I read somewhere that if more than 10% of the links to a page have the same (or similar) anchor text, it's obvious that you're on the bad list.
Moz Pro | | nsjadmin0 -
Gained Links but MozRank drops. Why?
I'm working with a client whose external followed links rose from 897 to 2792 in about a month. However the client's domain MozRank dropped from 4.52 to 3.82. What is a possible cause for this drop?
Moz Pro | | Fueled0 -
Seomoz research tools question for inbound links
What is the best seomoz tool and or indicator within a tool for checking on a link (directory or article site) to evaluate whether or not you would actaully want a link from them? Any way to see if google penalizes them for there tactics or if that can hurt me by them linking to me or whatever? I am at the beginning of a link building mission, but want to ensure that I do it methodically and correctly as possible based on the combines wisdom of this community. Thanks for your help, Steven
Moz Pro | | sfmatthews0