OPen Site Explorer listing criteria?
-
Checking link data for a potential client who has given me access to their websmaster tools account, I've noticed that Google list over 150,000 "Links to Your Site" but yet OSE only reports a tiny fraction of this number.
I have manually verified that there are in fact direct links from the sites that are listed in Webmaster Tools but not in OSE.Does OSE discard some links? Is there a reporting lag? Does anyone know why there would be such a large discrepancy?
-
Thanks anyway but no this client has never before done any structured SEO or link building. The site is a long established site with thousands of clients linking back to it and the checks I've done show that they are natural links.
I'll do a bit more digging but my previous observations had been that GWT underestimated the links versus OSE or previously Yahoo Site explorer. This is so far the other way around it is odd. -
That does seem a little odd. I tried finding info on how many links Google claims to have indexed, but couldn't find a reliable source. We indexed 38 billion domains and 387 billion links in our last Linkscape update.
That said, with how our crawlers work, if you're getting backlinks on domains with loads of other links on the page (which often happens if you're buying links), our crawlers will not grab every link on the page and that would definitely lower your backlinks profile with OSE.
-
Thanks Erica but in this case there are 19011.4% more links in GWT than OSE.
Would your diagnosis explain a gap of that magnitude or should I be looking for something else? -
OSE's data comes from our own crawlers. The simple fact is that our crawlers do not reach the same amount of data that Google's do. We're working on it and continually improving this. We use our own crawlers because we believe in the quality of getting the data for ourselves.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is there a way for me to find out how a keyword would rank if it were on a specific site?
Is there a way for me to find out how a keyword would rank if it were on a specific site? For example, lets say that XYZ.com does not have the keyword "ABC". Is there a way for me to find out how the keyword "ABC" would rank if it were on XYZ.com?
Moz Pro | | TurboH0 -
Complex Rankings Issue For A Law Firm Site
Be warned, this is a complex issue that I have and will require someone who has some advanced knowledge about 301s and link penalty’s. I have a law firm client whose site is having some issues. There are some very complex details here so I'm going to articulate them in bullet points in hopes of making the issues easy to understand. So here's my root problem: We have poor organic rankings (4th, 5th, 6th page for most terms) despite Domain Authority of 32 (avg. 1st page competitor is 28) and some very strong white hat link building the last 60 days or so. How's their backlink profile look, you ask? When you look at their backlink profile in OSE, their spam score is a 1/17 (not sure if that's credible in any way). Lot's of links that score 5's on the spam score make up about 10% of their OSE links. Here’s where it gets tricky; those links are not directed the client's New URL, they are links that go to some old URLs the client used to have, for which they had an SEO guy who built all those crappy links. Those URLs with the crappy links (we'll call them The Crappy URLs) were 301'd (can we all agree 301'd is a verb?) to the NEW URL for just a couple of months. Shortly after that, NEW URL dropped almost completely out of Google, so the client turned off the 301s. So despite those 301s being turned off, OSE still shows all the links going to The Crappy URLs but is giving The New URL credit for them. Keep in mind, the 301s were turned off about 6 months ago so it’s a little strange that OSE still shows those 301s. This has led me to the conclusion that the Domain Authority that OSE shows of 32, is not a “real” number since it is seemingly based off links inherited from 301s that no longer exist. So now I’m trying to create an action plan for this client that will hopefully help us start to make some real progress in our rankings. This client does not have the budget to wait another 6 months for some sign of hope so time is of the essence. Here’s my theoretical action plans I’m choosing from and would like the communities input on which, if any, they feel is best (Also, if I’m missing something or you have an idea, I’m all ears): **Potential Action Plans: ** Do nothing, keep building quality links, creating quality content, monitor crawl reports/gwt for issues. That strategy is going to win long term. #1 + Create one page sites on The Crappy URLs, setup GWT for them, submit sitemaps thus forcing Google, OSE and other web crawlers to index them, thus removing any potential residual penalties from the 301s. NOTE: Currently The Crappy URLS are just landing on GoDaddy’s default landing page which is of course not being indexed by Google or OSE. #2 + Disavow all the bad links going to The Crappy URLS. Then once the bad links no longer appear in the OSE profile for each of The Crappy Sites, 301 them again, thus inheriting the good links but not the bad. #1 + 301 the Crappy URLS back to the New URL, while also disavow any links going to The Crappy URLs. The logic here is that if the road back to recovery is going to be a few months away no matter what, when the 301 knocked them back 6 months ago no reputable link building was being done. I am cautiously optimistic the linkbuilding we are doing will eventually off set any penalty’s coming from the 301s. Plus now we’ll know the 32 Domain Authority OSE is giving us is real. This is the one I’m leaning towards quite frankly because I think it will reduce the recovery time and we’ll know somewhat quickly (30-60 days) if it’s actually working. 1-3 could each take 90 days before we know if it’s working. So please, if you have any expertise with any of this, your help or advice would be appreciated. I’d rather not share The New URL for obvious reasons but if you must know, simply message me and as long as you’re legit, I’ll share it with you.
Moz Pro | | BrianJGomez0 -
Now our site is ready what's next
Site is all inxed in google, with analytics and webmaster tool. No error in all our 5000 products pages So where do i start my organic seo? What should I read first? Its an online store for retailler only but we still want people to learn about the product or find a store.
Moz Pro | | koloss
We have made 300 original video on youtube with a full description these video are also associated in our site in each respective product. I know our competitor. So now everything is clean and ready. How do I start seo, we have no external link at all. Wich would be the first best step to do. Regards, Bruce0 -
Sites Blocking Open Site Explorer? Penguin related.
Last week I was looking at a competitors site who has a link scheme going on and I could actually check the links for each anchor text. This week they don't work at all, do you think they're blocking the rogerbot on their domains? Or is there a problem with open site explorer? http://www.opensiteexplorer.org/anchors?site=www.decks.ca If you're interested in the background, all the links are to instant-home-biz . com which then redirects decks . ca - it's a tricky technique. Pretty much all of the links are from sketchy sites like: airpr23.xelr8it.biz/ airpr23.anzaland.net/ airpr23.vacation-4-free.com/airpr23.blogfreeradio.net/airpr23.blogomatik.com/http://www.morcandirect.com/mortgages/resources2.php which I thought Penguin was supposed to catch…
Moz Pro | | BeTheBoss0 -
What is the time range of social media metrics of Open Site Explorer?
Hi, I have a client with a huge efforts on social media and I want to know which is the time range of the social media data collected with OSE. Or is using some sort of APIs, so is showing totals? OSE shows this: Times Shared on Facebook: 932 Facebook Likes: 1,898 Times Shared on Twitter: 191 Times Shared on Google +1: 52 Total Social Shares: 1,175 Thanks 🙂
Moz Pro | | CristianGuasch0 -
Internal links not showing in Open Site Explorer
So I'm working on a law firm site and looking at the links for pages in OSE. For practice areas, the links to each practice area are in the left hand menu on every page of the site. Can anyone help me with this question: Example: http://www.comitzlaw.com/personal-injury/car-accidents.html When I plug this URL into OSE, it only shows one linking page, www.comitzlaw.com/practice-areas.html, yet there is a link to this on every other page in the site. When I plug in a random competitors page, www.lesagelblaw.com/Personal-Injury-Overview/Car-Accidents.shtml, it does show all the internal pages linking to it. Since I'm not using a flash menu or javascript, any ideas as to why no internal links are showing up in OSE? Even when I plug in the main URL for the home page, it only shows 4 other internal pages linking to it, yet there is a link on every page. What am I doing wrong?
Moz Pro | | c2g0 -
Open Site Explorer Missing URL's
I see a link to my site on a couple different url's, but they are not listed in OSE. The links have been active for a long time too. Does OSE not track all inbound links from all sites? Thanks, Stephen
Moz Pro | | stats440
