OSE Too Slow
-
I have a client site that's been up since March. GWT reports over 60 linking domains, most of which are relevant and high quality, yet OSE has never shown more than eight
anyone else have similar experience?
-
I use Majestic in combination with OSE. The former is great for raw counts and fast discovery, the latter gives me generally more reliable data (in terms of links that still exist, come from relatively stable sources, etc) and better metrics/filters. I thought Eric Enge's comparison was quite good: http://www.stonetemple.com/majestic-seo-open-site-explorer-shootout/
-
Sounds great Rand, but until then, to show clients progress, I'm going to have to use one of those barebones list-of-links indices.
-
Hi Wayne (and other folks),
Sorry for my delayed response. I agree that this is a serious problem faced by our indices, and it's one we're working to solve. The main issue is how we make a web index. In order to get metrics and all the views that power OSE (as compared to more of the barebones list-of-links offered by some other web indices), we have a lengthy processing step.
This means we can crawl the web for a few weeks, then we need to process for a few weeks, and our processing time often puts us behind other indices in finding and displaying links.
We're working on a way to eliminate this issue, but I suspect it will take 6-9 months to get this in place. In the meantime, we're building a datacenter that can process links more quickly so we can hopefully get better (even if it's not perfect) in the meantime. Look for faster indexing by January/February of 2013, and then much faster discovery by summer.
-
I use Raven Tools which gets its link data from majestic. They are pretty decent. A bit behind but also more up to date than OSE in my experience.
-
Any chance of sharing some of your other sources?
-
Your best bet is to just use GWMT for links for now. I tend to use a variety of sources just to get a feel for what is being crawled. It is still good to check OSE, but I would not use that as your primary method if you have to give client reports or anything.
-
I get that OSE is trying to be discriminating and discount spammy non-relevant directory links but most of my links are good quality and highly relevant.
-
It is very poor with recognizing links quickly.
In this latest round of updates OSE finally recognized links that I got a year ago. But still is missing a ton of 1 way links that I got from attending a conference in June.
I have been building a lot of 1 way links through networking and yet my DA is going down?? and the links take forever to be picked up.
-
Vikas, I have high quality links from the government of Canada which have never appeared in the OSE index.
-
Yes I have the same issue. I believe this question should goto seomoz, I made links more than one month back still none of them showing up in OSE today after more than a month.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
AM I the only one getting misleading titles in OSE?
I am trying to locate directories in my competitor's links using OSE. Here is the workflow I am using: Filter all results to external sites only, group by site, linking to any page on the domain. Export results to csv. My competitor is in the web design industry. So I try to filter the titles of the pages linking to the competitor to look for titles containing directory. But when I click on the link for "Windsor Internet Web Design Hosting Ontario Canada Directory" I get a page with the title "Kitchen & Bathroom Showroom | London Ontario | Bathroom Vanity Showroom" Are the results really this misleading?? or am I doing something wrong here? Any insight or help would be greatly appreciated.
Moz Pro | | tdlabs0 -
OSE - Group by Domain Export
When exporting inbound link data from OSE, it seems to lose the "group by domain" filter. Is it possible to download the data like that or do I need to filter through all the links myself? Thanks!
Moz Pro | | cccreationsinc0 -
Q&A Forum Slow Performance
The dashboard works great, but the time to get a link to respond in the Q&A forum is painful. I am on a 15Mb connection and have an SSD hard drive. It is only this site that is slow. Is anyone else experiencing this? Or are you all very patient?
Moz Pro | | manintights280 -
Why does the CSV report on OSE limit the number of links I can download to less than it should?
I run an inbound link report for the domain www.acornstairlifts.co.uk on OpenSiteExplorer.org using the following filters: Show: All Links from: only external Pages to: pages on this root domain Show links: ungrouped It says that there are around 30,678 links for that query. I then go to the advanced tab, and run a report using the same filters, but when I click download report I only get 2874. I've run this for the past 2 days and I get the same. Why?
Moz Pro | | Brett-Harland0 -
Can we add sites to the crawl queue for OSE?
Is it possible to request that Open Site Explorer crawls a new URL on its next run? This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating. I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool. It would make sense that OSE crawls the sites that Moz members are working on wouldnt it? Scott.
Moz Pro | | eseyo0 -
Discrepancy in OSE data
When I look up a domain in OSE, it shows that there are 3K+ links from 349 domains. However, when I download the CSV, I only see around 1,500 links. Why the discrepancy?
Moz Pro | | inhouseseo0 -
Are header directives such as X-Robots and Link supported by OSE/Linkscape/SEOMoz tools?
SEOMoz tool reports show lots of duplicate content where there are http header directives in place on pages to eliminate dupes. Googlebot obeys but Roger the robot doesn't. Are header directives such as X-Robots and Link (rel=canonical) supported by OSE/Linkscape? I'd like to put my mind and clients at ease. Thanks
Moz Pro | | Mediatorr0 -
Some thoughts on MozTrust based on OSE Findings X ref'd with SERPS
I've been doing a bit of competitor analysis for a client using OSE. There are a group of about 4 websites (our clients website included) that all dominate the sector with none of the 4 clearly out in front (call this GROUP A). Then there are another group of about 5 websites, which come lower in the SE's consistently than the top 4 (Call this GROUP B) **I've been doing some analysis in OSE: ** ALL GROUP B Websites outrank all of GROUP A websites in the OSE Metrics (Including Trust Rank). I did some analysis on the backlinks in Group A VS Group B Group A - Generally a mixture of ok links from blog posts, sponsorship, and ok directories. Group B - As A, but with fewer numbers of links from quality blogs PLUS A high level of spammy links ( .edu and .gov spam filled pages), very low quality, almost non legible blog posts on MFA sites (think Digital Point sellers). From the above it is clear that the OSE metrics are out of whack with the real SE results. Clearly OSE has a few problems with working out what are spammy links and what are decent. Obviously google also has issues with working this out, so I am not surprised that OSE also does - but that doesn't solve the issue. This is a general discussion - so I would just throw in a few thoughts on how OSE may possibly try are overcome some of these issues : 1/. % Trust Links vs Non trust Links:
Moz Pro | | James77
Add in a metric to Trust Rank where the number of links close to trusted sites are also compared to the number of links not close to trusted sites. If you see a very high ratio of links from sites that are not close to trusted sites, it is a strong indicator of spammy links. 2/. Use seed "Non Trusted" sites to create a negative Trust Rank
Use something like a reverse of the "trusted sites" theory, but taking a load of very clearly spammy / link manipulative sites and work out in terms of links connections how far the site is away from these sites. Thoughts???0