Opensite explorer issues still there
-
Hi
I asked a question a few weeks ago regarding the linkings being shown in opensite explorer showing crazy stuff like psds and odd file formats as being the source of the links.
I was told it was being repaired , the results were almost useless and I stopped using , I have just logged back in to check again and see even more random odd results with sites that would have no reason to link to us.
Is this tool ever going to be repaired ?
Is there a ETA for the fix ?
How come you are launching new tools when the existing ones dont work ?
Kind Regards
-
Hey LL - totally hear you on both fronts. With Linkscape, Ryan's precisely right. We went crawling deeper on large sites, and, as I noted in the blog posts around this issue, encountered these binary files. We attempted a fix for the past index using a blacklist of file types. It only caught about 40% of them. We were hoping that would be closer to 90%.
We've got two new indices running. One that launches mid-November that will have more of these files removed but not all, and another in December when we think we'll have them all cleaned out.
In terms of Google's search query data in Keyword Difficulty, that does suck. Google turned off our API access and we've been going back and forth with them to try to turn it on. We, along with a few hundred other tools, got shut off all together and trying to get back in has been a long, painful process. However, the tool does not rely on this data to get accurate reports (difficulty doesn't care how many times something's searched, just how competitive the top results are, which is what we look at). Thus, the tool's still fully operational, and you can still grab the KW data from Google's AdWords tool or your own API access (not as convenient, I agree).
TL;DR - We're fixing the OSE binary files issue by December (maybe sooner) and working with Google to try to get the Adwords API data back in KW Diff (but no guarantees).
Hope that helps and a million thanks to Ryan for jumping in and helping out on this. He's not an official rep or a Moz employee, but seriously appreciate him going above and beyond.
-
I'm so sorry about the frustration you're having. It's not quite 5:00 in the morning Seattle time, so it may be a few more hours before you can get a more complete response. I couldn't sleep and happened to be checking email and saw these replies. What I can offer you right now is Rand's post about this latest update at http://www.seomoz.org/blog/november-2011-linkscape-update. He says the following about the binary file issue:
As I noted in the September index update, we have had some serious issues when crawling deeper on large domains and encountering binary files that contain code our crawler recognizes and treats as a link. To help stop this problem, we applied a black list to this index to stop a large number of the files folks had reported to us (our estimate is that ~40% of binary files are now removed). However, we know there's still more than a few of these in the database of links so we'll continue cranking away on solutions to remove them all. Our hope is to have them reduced in the next index (November) and nearly eliminated by the December index. If you're ever curious about the next/previous updates, you can always see data for them on our Linkscape calendar.
-
The next OSE update is scheduled for Nov 15th, but the crawl is already a week in. The issue will likely be resolved, but the question is whether you reported it in time to be fixed for the Nov 15th update, or whether it will be in the December update.
Good luck.
-
Let's be clear on a couple things here. YOU came to the COMMUNITY Q&A and asked a question. I am a member of the community. I pay for the SEOmoz tools and service just like you. I am donating my time in an effort to help a fellow community member (you) with a problem they are facing. I am doing so without receiving any benefit other then possibly your appreciation. Your swearing and anger are completely misdirected. Lashing out at the people who are trying to help you, and getting upset at "the messenger" who is sharing accurate information wont help you either.
SEOmoz policies are clear. If you are experiencing an issue with a tool, contact the help desk! help@seomoz.org. The Q&A is for general SEO questions, not for reporting bugs.
Your McDonald's analogy is horrible with no realistic comparison here. SEOmoz offers dozens of tools, blog, Q&A and more. You are mentioning a single bug which, while annoying, does not prevent you from compiling accurate data which is very informative and actionable. The tools are under constant development WHICH IS A GOOD THING! Trying to offer the latest and greatest has risks, and bugs are one of them.
Majestic SEO offers some nice tools. The overall feedback I have heard regarding comparisons between the two tools specific to backlinks is "OSE is better hands down". Opinions vary, and you are welcome to go try competing tools if you have the belief they are better or would otherwise solve your problems.
-
Tried option 1 holding breath
-
-
OK I just ran a check on site and the same crap I reported over 2 months ago i coming up
欢迎光临UPS www.ups.com/asia/cn/chsindex.html/route/board.php?bo_table=pds..
From the linking root domains page I get all these false results
| *.swsoft.com/ | 90 | 18,408 |
| *.ups.com/ | 90 | 39,423 |
| *.fcc.gov/ | 86 | 24,978 |
| *.spaceweather.com/| | |
| | || 80 | 8,182 |
| *.hostmonster.com/ | 75 | 44,325 |
| *.ndrc.gov.cn/ | 73 | 5,173 |
| *.bsplayer.org/ | 71 | 1,535 |
| *.rosettastone.com/ | 71 | 2,240 |
| *.iiasa.ac.at/ | 63 | 1,711 |
| *.echo-online.de/ | 61 | 3,020 |
| *.interwoven.com/ | 60 | 994 |
| *.hostingzoom.com/ | 47 | 398 |
| *.policyinnovations.org/ | 47 | 683 |
| *.gamania.co.jp/ | 46 | 771 |
| *.meijo-u.ac.jp/ | 45 | 733 |
| *.eon-mitte.com/ | 43 | 207 |
| *.circlecube.com/ | 42 | 175 |Add to this that the keyword research tool now gives no indication as to the search volume , google search data removed and this is now less of a service than was originally signed up for.
I wasnt aware that the service cost has gone down. If I go into a Mcdonalds and ask / pay for Big Mac and fries, I want big mac and fries not some crap lame excuse that the fry maker is down so I just get a big mac. I think sucking up and oh well blah blah blah blah excuses dont help myself or you anyone else. A definite fix date would be nice. If / when tools go down on our site we do NOT CHARGE CLIENTS for that month. I know of 2 other Moz users who have cancelled and gone to Majestic , I am wanting to stay with Moz but when I cannot trust the results I am seeing what choice do I have ?
PS It is a buyers RIGHT to be pissed off when said function /services dont work as promised, so please no more BULLSHIT arse licking replies.
-
In my experience you have two options:
1. Share specific examples of the issues you are facing by e-mailing help@seomoz.org. If you do such the issues will be resolved in 1-2 crawl cycles, depending on where the current crawl is at when the issue is reported.
2. Do nothing which means you are relying on others to submit an example of an issue and hoping the fix for their issue resolves yours. Option 1 is highly recommended.
At this point you can correct me and add option 3 which is to use another tool. That is always your right but many SEOs feel OSE is an invaluable tool which they cannot work without.
-
Hmm I having to contain myself here
-
Hi Ryan,
Thanks for jumping in here with a quick and helpful response.
We do expect to see an improvement (though not a complete solution) with the release of this month's index. We use our own tools, so we encounter these problems as well, and understand your frustration. We are working as fast as we can to get this issue resolved, and do thank you for your patience.
-
The OSE results are based upon the Linkscape crawl of the web. They are updated about once a month.
The last update was Sept 13th. The next update is Oct 18th. The update schedule can be seen here: http://apiwiki.seomoz.org/w/page/25141119/Linkscape%20Schedule
We all want the tool to work better. The tool worked great for a long time, but it only captures a limited portion of the internet. Requests were made to adjust the crawl to go deeper. When the changes were made, the issues you refer to appeared. The problem is when the issue was discovered, the next crawl was already in progress.
The bottom line is with a 4-5 week period between updates, it will take a lot longer to resolve any issues then any of us will be happy with. We all hate this problem but even with it, OSE is still an outstanding tool.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Link check via open site explorer not working?
Not sure why this is happening but when i run our site though open site explorer it is only coming back with 1 link yet we have at least 10 - 20? our site is https://www.fastlabels.co.uk and i tried without the https:// so www.fastlabels.co.uk Any help would be appreciated.
Moz Pro | | BobAnderson0 -
Whether or not to remove a link from a website with high spam score on Open Site Explorer
Hello Moz! I just subscribed for your Moz Pro program. Amazing stuff! On open site explorer, I found a number of links to my site from a page called with a very high page authority and high domain authority, but also a high spam score (8 or 9, one with a 10). I say multiple spam scores, because it's strange, there are what appears variations of the same url, and each one is considered a link. For instance, there's an abc.linkstomysite.com and xyz.linktomysite.com, and 123.linktomysite.com... there are about 15 of these (all with the spam scores mentioned above)! This must have been some old SEO work done I payed for back in the prehistoric SEO days. However, my fear is the following: Removing these links, and then losing some potentially strong link juice. I don't have many high DA or PA links to my site, and these are some major ones. The domain in question "linktomysite.com", when entered into OSE, only has a spam score of 4, and it has a domain authority of 45 and page authority of 37. My site has a spam score of 2 and no messages from google regarding a penalty, but an overall reduction in google traffic over the years (just keeps slowly dropping... as if a weight is pulling me down?) What do you think, should I leave, or remove? The linkstomysite page is just a LONG page full of links, with short descriptions, nothing of value, but with a an old domain age (relatively). Most important for me is keeping at least some ranking/visibility, while I personally work on building quality links and helpful content. thanks!
Moz Pro | | DavidC.0 -
Open Site Explorer and Escaped Fragments
Does OSE have the ability to crawl AJAX pages utilizing Google's escaped fragment directive? I ask because I'm seeing all our AJAX built pages returning HTTP status codes of 404 when I run OSE reports. See for yourself
Moz Pro | | RyanOD0 -
Why is my crawl STILL in progress?
I'm a bit new here, but we've had a few crawls done already. They are always finished by Wednesday night. Our website is not large (by any means), but the crawl still says it's in progress now 3 days later. What's the deal here?!?
Moz Pro | | Kibin0 -
Open Site Explorer and link numbers
I know this question has been asked many times in this forum but I still can't work it out. Why does this link: http://www.opensiteexplorer.org/links?page=1&site=www.bookpal.com.au&sort=page_authority&filter=&source=external&target=subdomain&group=0 Which is showing all links, external, to pages "on this sub domain" show 1,935 external links but this link: http://www.opensiteexplorer.org/links?page=1&site=www.bookpal.com.au&sort=page_authority&filter=follow&source=external&target=subdomain&group=0 which is exactly the same but this time shoing followed + 301 links, says "showing 1 - 50 external links) but won't show the total links (and I know the mouse-over on the question mark says it's won't show the total links, but I don't understand why it can't show the total links when it could show the total links when I requested to see "all links" instead of just "followed+301" links.) but it actually lists 700 links (14 pages, 50 results each page). I know the link list is limited to 25 links per domain but then it means you can NEVER know the total link count unless you download the full report. This makes using OSE to know numbers of links (internal, external, or otherwise) impossible. And if anyone uses the API, why the API (external+follow) returns 1,451 links? I'm sure it's an ongoing issue with people trying to get their head around all of this and I've never really been able to. Any insight would be much appreciated!
Moz Pro | | eatyourveggies0 -
Adding canonical still returns duplicate pages
According to SEOmoz, several of my campaigns show that I have duplicate pages (SEOmoz Errors). Upon reading more about how to resolve the issue, I followed SEOmoz's suggestion to add rel='canonical' <links>to each page. After the next SEOmoz crawl, the number of SEOmoz Errors related to duplicate pages remained the same and the number of SEOmoz notices shot up indicating that it recognized that I added rel='canonical'.</links> I'm still puzzled as to why the SEOmoz errors did not go down with respect to duplicate page errors after I added rel='canonical', especially since SEOmoz noticed that I added them. Can anyone explain this to me? Thanks,
Moz Pro | | MOZ2
Scott.0 -
Open Site Explorer: Facebook Likes Accuracy
I show in open site explorer that I have 8 Facebook likes for my domain but I actually have 1500+ Facebook likes. Am I missing something?
Moz Pro | | fibers1 -
Still Getting Keyword Self-Cannibalization
I used the onsite optimization and made some changes to my post, but am still getting the Self-Cannibalization mention in my results. It lists this: "Real Estate Careers | Keller Williams | Career In Real Estate" as the link that is not supposed to be there. This is not a link, but the title of the post. What am I missing?
Moz Pro | | brentmitchell0