Open Site Explorer.. Bit of a let down?
-
Hi, not too sure if this is a discussion or rant!?
I’ve been following SEOMoz for a couple of years now. Testing their tools, reading their blogs, sharing their content, and watching the whiteboard Friday videos (massive thumbs up to that one!). They are at the top of the game, no argument there.
Although I should have done so much earlier, I have eventually signed up to the pro version and am about to migrate all my clients over. But there is one major caveat which I’m not sure should exist.. Open Site Explorer.
Don’t get me wrong, OSE provides invaluable metrics, some that no other ‘crawler’ provides, but it is far from perfect, there are things that we SEO’s need, and are hoping to get!
Some feature SEOMoz could add;
- Ability to view a chart of ‘link types’ (i.e. blog post, social media, Press Release etc..) – Linkdex do this!
- Utilise a ‘fresh‘ backlink index as Majestic SEO do. ( we do use majestic alongside SEOMoz)
- Crawl more frequently – enough said!
- Index all ‘not so good’ backlinks – this will help identify what backlinks AREN’T helping.
I realise this is a lot easier said than done, and I’m sure SEOMoz are working on solutions.. just can’t wait till they launch!
What do you think? IS OSE more than it’s cracked up to be? Could it be improved? Let me know
Lee
-
Wow Rand, thanks for such a detailed and frank answer, I now have a better understanding of the issues you face.. it's much more complex than I imagined. Great to see that you''re doing all you can, look forward to the improvements.
Have a great week! Lee
-
Hi Lee - thanks for bringing these up! I'll try to answer with regards to each of the items you've mentioned:
#1 - This is very tough at our scale (literally 1 trillion+ links, and in the latest index about to launch, 150 billion+ pages across nearly 200 million domains). However, you're correct that we're working towards a classification system that will lean on some seeding + machine learning + user input. I'd suspect 12-18 months before we can launch it, though.
#2 - This is not currently in the plans, at least not at full web scale. We will have Blogscape back up and running soon, and that crawls ~10mm+ fresh sources daily, so if you have a link/mention on a blog/forum/news site with any notoriety, we should be catching those and updating hopefully every 6-8 hours. Mozscape (aka Linkscape, our full web index), will continue to be at least 2-4 weeks between updates and will require 3-4 weeks of processing. We're trying some new things on the technology side, but it's a huge challenge to get to Google's scale and keep our metrics, sorting, views, etc. Majestic can do this with their index because they simply export links directly into the consummable portion of the app, but it limits the sorting/views/filters and ability to generate high quality metrics like PA/DA/mozRank/etc.
#3 - Yup. Definitely agree and working on it. We're trying some new hardware stuff, new parallelization of processing and everything under the sun to make it work.
#4 - Our next index will probably have a lot more of this (and we'll be watching carefully to see how this performs for our customers). We're also working to build a spam score that maps against what we've seen Google penalize/ban over time (currently doing a bunch of research there), so you can get a good sense of what things are likely to be hit over time.
Mozscape/OSE is a huge priority for us and we have 7 extremely talented folks working night and day (and a lot of weekends) to improve this. In the next 3-6 months, it will get massively better than it is today - the next new index is only a few days away now, and after that, we shouldn't ever have such a long period without an update (this round was an impossibly hard-to-fathom confluence of problems that we've taken many steps to prevent from ever happening again).
Thanks for your patience and the good questions.
-
Ignore the last reply John, have just tested Link Detective on a site that I know the link backlink profile of.. it's massively inaccurate! The tool simply isn't able to identify correct link types as they suggest. Dissapointing!
-
I've read they would be indexing 2 x the data Anthony, not 3 x. Suppose there must be some confusion out there, fingers crossed it's 3 x the data!
-
Cheers John, will take a look when I get the chance.. have you used it before? Is it accurate?
Enjoy the weekend! Lee
-
Thanks for all the feedback guys, would be good to hear SEOMoz's official stance on this!
-
You might find this tool helpful to analyse your downloaded report from OSE
http://www.linkdetective.com/
-
I have to agree with Kevin on this one...
Items 2,3,and 4 are days away.
Does it suck that OSE's Linkscape Index hasn't been updated since the end of February? YEP!
Will it be worth the wait next week when it is updated and contains three times the data as the previous crawls? YEP!
I consider SEOMoz a community, and though Linkscape's stagnant data is causing some issues, I realize that once those issues are resolved that I'll be getting more bang for my buck than I did before, and I'm totally willing to struggle for a month in order to have better tools at my disposal for many months to come.
Rand and SEOMoz are drastically improving the volume of data that we will have at our disposal. That takes time and resources. They aren't raising prices or making excuses, they're working out bugs and improving the service. I'll take it.
Anthony
-
Lee,
First, I need to say I
OSE - it's invaluable in my forensic audit work. Having said that, I would LOVE to see the "link types" chart. The biggest challenge I expect they'd face in that is properly detecting where a link is on a page, or what class to put it in due to how unspectacular code consistency really is across the vast web. For example, I've seen others attempt this and fail miserably ( what should be identified as a sidebar (blogroll type) link is often seen as something else, and what should be seen as a main content area link is often seen as a sidebar link (too many WP themes for example, label their main content area divs as "sidebar2" for example).
And that just gets worse / more challenging when the need comes in identifying if a site is really a blog, or some other site that happens to use WordPress as it's platform.
Having said all that, I would be in heaven if the Moz team could get that data into OSE
-
From following all the talk, I'm pretty sure they are working on points 2, 3 & 4.
While all that is good, I personally feel they should concentrate on updating more often first, then move towards giving those extra features. The two month stretch between updates has been a real pain in the ass. But I'm sure they know that.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Bug in site crawl analysis - 308 redirect flagged as temporary
Hi, we have some 308 redirects on our website, which are permanent redirects, but the site crawler is flagging them as temporary currently. Screenshot 2022-02-10 14.24.26.png
Moz Pro | | pm-mbc0 -
How to make Seo Tools Site serves ?
hello i want to add seo tools at my site for users i want my visitors able to use pagerank checker , link tracker , backlinks checker , etc - and keyword tools , domain tools , Analytics and Reporting. something like http://smallseotools.com/ what scripts i need ? can i do this all with wordpress ? Thanks 🙂
Moz Pro | | Wagdys0 -
Open Site Explorer - Link Export Not Showing Same Number of Links
Noob question. I'm using Open Site Explorer to hunt down some external links for a website. In the attached image (post-pressing the filter button), it says I have 889 external links, but after I've downloaded the CSV, I only get 695 links. Why the difference in number? And if I'm doing something wrong, how do I make sure I'm getting the full amount of external links to my client's website? Thanks! GG6wURf.jpg
Moz Pro | | EEE31 -
To Many Links on site
I've had an issue with to many links on the site. My drop down menu, secondary footer and footer. The report told me that I had 253 links on each page. I then programmed my secondary footer to dynamic and ran a crawl and my links reduced accordingly to 201. Then turned the footer into dynamic and ran a crawl with my links increasing to 1500. This also happened between each phase but en went away. Oddly enough, my domain authority increased as well as other factors in the crawl report. This too many links thing is driving me crazy. Please provide some guidance.
Moz Pro | | CHADHARRIS0 -
Help with various bit?
Hi again, Right I have wrote some notes on what I have read on here, the web and from my diagnostics. Our site is a e-commerce site for mens designer clothing. All back end editing has to be done by the web firm who host it. We can edit CMS stuff such as SEO title, descriptions, product info etc... Any help or clarification would be greatly beneficial, right lets go (sorry about the long read). <70 title characters, this is something I am going to implement on the back of some advice on here. Does it matter what order words appear in the title? Eg) Mens Blue Armani Jeans Jacket or Blue Armani Jeans Mens Jacket. Would it really matter? Is it good practice or worthwhile to use seo titles with the colour of the item at the front? I ask this as I am not sure if we would be affected by starting the first few words of each title with the brand name. eg) Blue Armani Jeans, Red Armani Jeans as opposed to Armani Jeans in Blue, Armani Jeans in Red? SEO title still, should I just include what that item is and nothing else? Or does adding something else at the end go against you? eg) Blue Armani Jeans as opposed to Blue Armani Jeans | Mens Armani Jeans UK? Am I trying too hard to get relevant words in there? Our meta descriptions are about 170-220 characters long for each item/page, is this too much? Sometimes struggle with the uniqueness of descriptions, as we can have loads of the same item, but only the colour is different. So after 5 go's, words get harder to put together. What % of a description do you think needs to be unique? Next is what comes from the crawl diagnostics Duplicate Page Titles: We are being warned because each page is showing up with a sort applied to it or pages that no longer exist. We also have filters for product types, so we show as dups for say all-clothing/armani-jeans/ has the same SEO features as shirts/armani-jeans/ and say jeans-trousers/armani-jeans/. I don't have the ability to SEO the filtered titles in the CMS. How would I fix this? Long URL: How important is the length of the URL? I make sure the URL is what the item is eg) armani-jeans-mens-jacket-6A554. The number at the end is the items style number. Should I always keep the URL as short as possible? And how far over the 115 is acceptable as for some items were only 1-10 characters over and its hard to go shorter? No. of links per page: Due to being an e-commerce site, pages such as TOPS could have over 100 products easy, not to mention the links in navigation etc... How important is this? Rel Cononical: We have 2,591 of these. What are they, how can I fix it? It is important? H1 tags: Should these be put on keyword phrases on each brands page? Should it go on the homepage only? How many H1 tags on a site/page can you have? I can't go back end code so webfirm would have to edit. Howver in CMS I can H1 product decriptions and brand descriptions, would that be useful? Keywords within the CMS, how useful are these? They are becoming a pain to do, so I don't want to do them if I dont have to. How many would be too many? Product On Page Descriptions: How long should these be? Does it matter if its a bullet list of features? Or should it just be 2-3 lines of what the item is, features etc...? Sorry for the long essay, just my notes from the last few days. Thanks Will ps. if you want to view the site its www.designerboutique-online.com
Moz Pro | | YNWA0 -
Is there any alternatives to Yahoo Site Explorer?
Hi, Is there any alternatives to Yahoo Site Explorer? I want to find backlinks of some unavailable pages and YSE was a great tool to deal with. But when I used tools like Open Site Explorer, ahrefs.com etc., I couldn't find one same like YSE. Because when I tried, it shows'No data available for this URL' where on YSE I found inbound links. What Alternatives Are There? thanks in advance!
Moz Pro | | VipinLouka780 -
How often are open site explorer reports updated?
I collect the information contained in open site explorer reports and csv backlinks audits on the 15th of every month. I noticed that the numbers are unchanged from 9/15-10/15. How often are the reports typically updated?
Moz Pro | | seagreen0 -
Open site explorer - Analysing competitors links
When using open site explorer to analyse my competitors links, when going through them, I would click them to have a look at them. Almost all of the ones I clicked on something started to download on my computer and would be a blank page or the tab would disappear when the download begun. What is this? Why have they done this? Is this bad practice? Thanks
Moz Pro | | CompleteOffice0