Any SEO moz users notice a HUGE change in OSE (Open Site Explorer) link data numbers?
-
Hi All,
I am having some serious concern with OSE data recently for numerous clients, one client I want to talk about today has the following data from OSE for the month of August 2011 compared with July 2011:
Total links to the domain: (decrease of around 100,000+)
External Followed links: (decrease by around 5,000)
**Linking Root domains: (decrease of over 60) **The crazy thing is that the domain authority has actually gone up by around 5 points for this client even though every thing has suddenly gone down?
Also funny thing is we have been link building quite strong for this client over the last 12 months using only high quality sources from out niche.
I am worried that their is serious issues with the data, I realise we saw some updates to OSE recently yet I am suprised it can be this drastic.
Kind Regards.
PSV
-
This topic affects everyone and Rand offered a specific reply to address these concerns. In short, they are working on the issue but there is only an opportunity to make adjustments once per month. Then the crawler is set to do it's job and the results wont be seen for another month.
The crawler has to go out and pull data from literally billions of web pages. The data then needs to be processed which takes 1-2 weeks. The team is also trying to improve the quality of the tool as well. My recommendation is to use OSE as a guide, not a solid list of all links.
-
Almost 2 months later from last post (Sep 5) here and I am wondering why this problem with OSE is not rectified??? Oh yea, here's another $100. Thanks so much!!?
-
Hey PSV,
Sorry I'm jumping in so late to the game on this! The response from the Customer Service team by Kenny below is correct - with the adjustments we've made to the new crawler, we're going less deep this crawl than we did in the July crawl. This is because we're still trying to make tweaks to get the domain diversity back up to what is what before. It looks like you had a major change from July to August which is strange - I haven't seen such a drastic change pointed out by any other users.
If I could get the actual domain, I can look into this for you. Is this discrepancy being reported by Open Site Explorer or are you querying the API directly?
It's hard to speculate without knowing which domain you're referring to, but you may see a decrease in inbound links if you had a lot of links from a high MozRank page. If you had a large amount of links on one domain and we didn't crawl that domain as deeply this past index where we went MUCH deeper the index before, many of the links deeper down in the domain won't be in this latest index.
Please let me know which domain you're referring to and I can try to track down some information for you!
Thanks,
Cairn
-
I have seen the same thing and posted a private Q along the same lines, having seen substantial changes with a couple of site profiles, both of which have had link building done very carefully with high value sources. Majestic and Google WMT still show the links - just a spanner in the works at the mozplex by the look of things until the next crawl.
Response as follows:
| Kenny Martin | Aug 31, 2011 |
| Customer Service Expert at SEOmoz |Sorry that you're seeing such drastic changes with the new Linkscape update. We've been adjusting the way that we do our crawls over the past couple of months, and the updates made in July were a bit off the mark. Our new crawler was built to be fresher, but it was going deeper into domains, and, unfortunately, not visiting as many domains. Domains with a high MozRank were getting crawled deeper, but domains with middle to lower MozRanks were not getting crawled. With our newer Index, we tried to get the domain diversity back up to or better than that of our last update (as was originally designed) so we didn't crawl as deeply into some of these higher ranking domains as we had for our July index.
Also, keep in mind that it can take some time for links to be included in our Linkscape index because it takes a few weeks to crawl the web and a couple weeks to process all the data that is acquired.
I hope that helps clear things up and we are anticipating on improving our crawler and index each month. My apologies for any inconveniences
-
I'm sorry PSV, I missed the 60 root domain information which you clearly included.
100,000/60 = 1667 so it sounds like some if not most of the links lost may have been site wide links. It's impossible to tell with this information alone. There are too many factors involved:
-
how many domains are linking to your site
-
which domains did you lose? Were they high DA sites or low?
-
which links did you lose? Were they foot links? Links in content? Links from high/low PA pages?
-
were they links to your home page or deep links?
-
did the links use anchor text or simply provide a URL?
-
How is your site's traffic? Have you noticed any recent changes?
-
How many total domains link to the site?
Do you save your links in Excel or have a tool to compare your current links with the past links so you can determine which ones have been lost? This step is key to understanding how to approach the change.
-
-
Hence why I noted 60 root domains loss, which I find a bit weird, as our other software shows gains.
I thought it must have been down to a system update!!
But yeah easy as to get a footer link a partner site footer, but it is not quality
-
Hi Nigel,
Yes we are using several tools for comparison currently we do not limit our selves to only SEOmoz data. I read Rands post about the link scape update, saying how lower quality smaller sites were removed from the OSE index yet this site we deal with has more high quality links in its profile.
-
I agree with Nigel's assessment and would add one thought. Look a lot closer at the number of linking domains, not the total number of links.
You can add a single footer link to a forum site with 100k pages. The link's value is minimal but you would notice 100k more links. What can you do with that information? Very little. It distorts your true backlink profile. If you were to lose that footer link but add 1 quality link from a source such a the New York Times, your sites DA may increase even though you are technically down 99,999 links.
-
I saw similar changes to the Data sets in the August update. I received feedback from moz, was that with the July data set they were crawling deeper into some of the larger (and more trusted) domains which was, in some cases, producing unusual results. For example, we had links coming from domains such as Warnerbros.com, which have no trace of a link to us.
I think the latest update has moved to rectify these issues but at the same time crawled a wider range of results giving a more accurate picture of link graphs for pages. I would suggest that comparing Data month and month to yourself is not a useful as mapping the changes your competitors are having i.e. with Seomoz making the great changes they do to make their metrics reflective of what matters in the SERPs the data will change month on month but if you are looking at how your competitors shift as well you'll get an idea as to how you perform.
I would also suggest using several tools, (whilst linkscape is pretty darn awesome) it's always worth getting a full picture of the link metrics by checking linking domains in webmaster tools, yahoo site explorer, bing tools, majestic seo etc.
In short I don't think there are serious issues with the data but it would be worth checking which domains you've lost and which you've gained, just to be safe.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Only 2 Inbound Links which are the Redirect 301 Links
Hello Everyone, We're having a serious Problem with the ranking of our website so we started testing the website in different Tools. Almost all of the tools say our website works great and in comparision to our competitors we win in almost every test – but we rank behind them. The only thing that makes me wonder is the fact that our website has only 2 Inbound links (Open Site Explorer) when the link source is set to only internal. And the only links shown are 2 links that come from the old http (we're using https) and redirect 301 to our https. No other links – in other tools we have around 80 internal links to our rmain https-webadress. Does anyone have an idea where that comes from? I'm afraid this might be our issue in ranking behind of lots of our competitors. Lokking forward to your ideas and suggestions.
Moz Pro | | Franksen3o3
Greets Frank0 -
Moz & Xenu Link Sleuth unable to crawl a website (403 error)
It could be that I am missing something really obvious however we are getting the following error when we try to use the Moz tool on a client website. (I have read through a few posts on 403 errors but none that appear to be the same problem as this) Moz Result Title 403 : Error Meta Description 403 Forbidden Meta Robots_Not present/empty_ Meta Refresh_Not present/empty_ Xenu Link Sleuth Result Broken links, ordered by link: error code: 403 (forbidden request), linked from page(s): Thanks in advance!
Moz Pro | | ZaddleMarketing0 -
SEOmoz PRO: How to manage a Site with 2 languages on the same domain - without mixing up data?
I want to track a "rootdomain" that has two languages on it, the english version is in a subfolder /en/ 1. http://website.de
Moz Pro | | inlinear
2. http://website.de/en/ I want to manage and track each language-version isolated. So I will setup:
1. http://website.de as campaign DE - german
= as Root Domain
But as there are links to the /en/ Subfolder these data will also be included in all reports. And there is still no option in SEOmoz PRO to exclude folders or even urls.?! This will be bad when wanting a clear report of just one Language Version. 2. http://website.de/en as campaing EN - english
To track as "Subfolder" will not work beacause this option will only consider exactly this subfolder... So is there a way to see data just only for one language Version?0 -
No link data for my domains + still no adwords data
All 3 sites In my campaign have no link data analysis done. 5 to 6 months after you said you were working on it Adwords data is still not available in Keyword analysis Partial service is understandable for a few days but not for months. Beyond the nice screens, what data & services do you exactly provide and what are we paying for?
Moz Pro | | ResourceLab0 -
MozTrust suddenly dropped to zero. Link data now unavailable???
I'm running an SEOMoz campaign for a small site to monitor some tweaks I've made and testing new things out. Over a year or so the changes were great - organic traffic was rising, domain metrics were too. Then in October 2012 domain trust, Moztrust and all other link metrics went to zero. There's no data in OSE for this particular small site and as far as I can tell, no impact on search. The limited number of inbound links all appear to be intact and there's no reason why the site would be hit by Panda/Penguin style updates. Why has this sudden loss of data occurred? Is the site no longer in SEOMoz's databases? Without any link data it's difficult to tell why this has happened. If it is no longer in the Moz database, how do I get it back - that data was useful!
Moz Pro | | StevieCC0 -
Links not appearing on Open Site Explorer
My site gained several new inbound links during December and only two of them are not all showing up on the latest Linkscape update. It seems to be the links that were created at the end of the month which are showing up, whereas a handful at the beginning of the month are nowhere to be seen. All the linking pages have been indexed by Google the links are do-follow, and one of the sites in particular is not obsure and has a DA in the 90's. I appreciate the Linkscape doesn't index everything, but I would have thought that more tof the results of my efforts would have shown up in OSE. I'd be really grateful if anyone could explain this to me please. Thanks Ben
Moz Pro | | atticus70 -
How can I Pull OSE Data for Multiple URL's at once
I'm putting together a link prospecting csv (very basic/simple). I'm doing my own manual hunting for link prospects and compiling them in a list in that excel doc. Once I'm done with that, I want to pull OSE data on a larger scale (MozRank, PA, DA, etc.). I know Niel Bosma's SEO tools for Excel exists, but I have a Mac, and it's not available for that. And I can't really pay for any of the big tools right now (ie BuzzStream). Does anybody know of a good tool or way of going about pulling this data in a way that will save time? As opposed to pulling data for each URL one by one. ANY tips would be GREATLY appreciated.
Moz Pro | | MichaelWeisbaum0 -
Why would Open Site Explorer say some internal links are images when in the source code they're text?
Hi, All! I was looking at OSE for one of my client's site's pages, and I saw that all internal links were said to be images. I was pretty sure their menu was CSS, and all the links were text. So I did "fetch as Googlebot" and looked in the resultant code of one of the homepage to see the main navigation bar. The navigation link for one of those pages looked like this: `onmouseover="doMenu2on(this);">[](http://www.mysite.com/solution_sub.asp?ID=8)` [``` <code>![](images/arrow6.gif)Anchor Text Here</code> ```](http://www.mysite.com/solution_sub.asp?ID=8) ``` The nav link for a page that does show internal anchor text in OSE looks like this: onmouseover="doMenu2on(this);">[](http://www.mysite.com/solution.asp?ID=5) [```
Moz Pro | | debi_zyx
<code>Anchor Text Here</code> So there is an image in the link (it's the little arrow before the text to indicate a sub-category), but the anchor text comes right after it. Is Linkscape (and therefore potentially Google) seeing them as two different links to the same page and only counting the first? But it's all wrapped within the same <a></a>tags. Any ideas on if this is a bug in Linkscape, or a real issue, and what should be done? Thanks! Aviva``0