Links counted in Google Webmaster Tools vs. OpenSiteExplorer
-
Hi all SEOmozzers,
site: http://f8phototravel.pl
I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other.
They are not present in OpenSiteExplorer.
Any ideas why?
Thanks,
Marek
*/ Alexa rank (Poland/Global)
-
Thanks Cyrus,
I need explanation how OSE works. Now know it and can wait for next results and work on good link connections. I will try to "flow to surface" with links from good sites in which I have buried links
Marek
-
Marek,
In the past, each Linkscape index started with the top 10 billion urls from the previous index, based on authority, and links were discovered outward from their. Today the process is similar, but the crawling proceeds on a more continuous basis.
Basically, Linkscape still has to discover URL through links. If there are not many linked paths from the top 10 billion URLs to a particular page (even if that page is on a high authority site) then Linkscape won't consider it a priority to crawl.
On the other hand, if there are short, clear routes to a URL, this means even if the page is on a low authority site, it might get included in the index. This is a more natural crawling system that, although not perfect, mimics the way authority is passed in the real world.
-
Thank you Ryan,
Great explanation. My idea is to make sure how it works and thanks to you i'm enlightened. I always try to understand mechanisms and rules of tools actions.
Thank you again:-)
Marek
-
OSE is based upon Linkscape's crawl of the web. The Linkscape crawl cycle is roughly a month. It takes 2-3 weeks to crawl the web, and then 1-2 weeks to process the large amount of data and provide it in a readily usable format.
When working with OSE it's important to know the Linkscape update schedule. OSE was last updated Jan 17th and will be updated again Feb 29th.
It's also important to understand how the crawler works. If you create a link during a period, you will often need to wait until the next period until the link is visible in OSE. I find OSE to be a fantastic tool for analyzing a site's backlinks. It takes time for OSE, Majestic or any other tool to crawl trillions of web pages and process the data. The tools will always be behind in the foreseeable future.
OSE is being adjusted to crawl deeper. In the past, it only crawled the top 25% of web pages. For the most part, if OSE does not see the link, the link likely has no value.
**I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other. **
Where is the linking page located within these sites? When were these links created? Those are the most relevant questions.
DMOZ is a PR 10, DA 10 site. Some pages are buried so deeply that neither Google or OSE crawls them.
In most cases, if a link is not discovered in OSE it is either two new or too weak (including buried links). If you feel neither is the case, you can submit the link information to help@seomoz.org and the help desk team will assist you.
-
Yes I know majesticseo and I wrote about it some time ago in Q&A What do you use Majestic SEO for?
Frankly speaking my question was a little bit provoking. It's a large number of tools ... each of them cost a money - that can be a problem, not big but...
My question is also about how the OSE crawl the pages/links, how accurate it is and in the end how long it take to crawl e.g. 50% of links?
And still I'm wonder why it crawls low ranked pages and not to crawl high ranked pages on specific market/country?
I really want to understand what is the scheme of OSE crawling work.
-
Besides SEOmoz, I would recommend Majestic SEO http://www.majesticseo.com/
-
I would wait and see what OSE says on their next update on the 29th. It looks like OSE crawls those sites, so either they don't crawl deep enough (as deep as Google does), or your links are newer and just not updated yet.
As for a reliable crawl tool, I believe OSE is great, but here is a nice post on a few other international tool. (based on OSE data)
-
Hi Brent,
I know that, already read lots of Q&A and other stuff ... but the thing is that OSE indexed links from my few domains (C Blocks) and other links from very low ranked sites.
I wonder why it doesn't index links from e.g. Google +1 and other high ranked sites?
It's a second month of campaign and few crawls behind...
It can be an issue for other campaign I want to perform for my clients ... should I use different tool for link tracking?
On the other hand my mR = 5.1, mT = 5.69, PA = 33, DA = 20 and all factors increased heavily last 2 months. At the same time my PR = 3 (from PR=0, 2 months ago)
Thanks
-
Google's crawler has a separate larger database, crawl rate ect, than OSE.
OSE indexes monthly where as Google's index is updated more often than that.
In short, OSE is just a different "snapshot" of the net then Google's much larger database of the web
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Only 2 Inbound Links which are the Redirect 301 Links
Hello Everyone, We're having a serious Problem with the ranking of our website so we started testing the website in different Tools. Almost all of the tools say our website works great and in comparision to our competitors we win in almost every test – but we rank behind them. The only thing that makes me wonder is the fact that our website has only 2 Inbound links (Open Site Explorer) when the link source is set to only internal. And the only links shown are 2 links that come from the old http (we're using https) and redirect 301 to our https. No other links – in other tools we have around 80 internal links to our rmain https-webadress. Does anyone have an idea where that comes from? I'm afraid this might be our issue in ranking behind of lots of our competitors. Lokking forward to your ideas and suggestions.
Moz Pro | | Franksen3o3
Greets Frank0 -
Link Profile - What is Good or Bad?
How can I tell (using Moz tools) which links are okay or not? Looking at them, some are clearly just for rank, but are they worth my effort in removing them? And, if I remove a bunch of links suddenly, will Google penalize me? And how do I know if my link profile is to blame? My site was ranking pretty well in June and has steadily fallen around 4-5 spots across all of my keywords. Some of my competitors without as good of DA, PA and links are outranking me.
Moz Pro | | CalicoKitty20000 -
Tool recommendation for Page Depth?
I'd like to crawl our ecommerce site to see how deep (clicks from home page) pages are. I want to verify that every category, sub-category, and product detail page is within three clicks of the home page for googlebot. Suggestions? Thanks!
Moz Pro | | Garmentory0 -
Google Webmaster Tools and Open Site explorer's links not matching up
My question is why do my GWT's links not match up to the ones on Open Site Explorer. I watched John Mueller's video, and he said that they had problems with the link counts recently. After checking my links today, I can see that the problem is fixed, but my link count differs from Open Site Explorer. On Web Master Tools I have 307 links, but on Open Site Explore I have 42. Has anyone dealt with this problem? thanks. Peter
Moz Pro | | PeterRota0 -
Loss of Google AdWords API
Since August, we've had intermittent access to the Google Adwords API. Like others in this space, they've let us know that our access has been revoked. We've been working to restore this access, but unfortunately, we have not been able to do so. In the meantime we are working hard to find a suitable replacement that is both stable and a good fit for our customers’ needs. We wanted to let our PRO members know, first to apologize, and second to explain how this has impacted your PRO access. We understand how important it is to have all your keyword data in one place, and we're sorry for any disruptions you've experienced from not having this data source in our app.We do want to clarify that this change does not affect your data from Google Analytics. The products affected by this change are our **Keyword Analysis tool and the keyword details and **keyword analysis pages within our web app. We removed this keyword query volume data within PRO a little earlier this year. You can still generate reports, but the metrics previously pulled from the Google Adwords data source is no longer there.The good news is, we don't actually use the Google AdWords data in our calculation of keyword difficulty, so these reports are still 100% accurate—they're just missing the information we usually pull from the API, which you can find on the Google AdWords Keyword Tool here. We're so sorry about this, and understand how frustrating the loss of this data is. We're hoping to have an alternative data source soon, and we will keep you posted as we make progress. Please feel free to comment, ask questions, and get help by replying to this post. Thank you!
Moz Pro | | AaronWheeler7 -
Is OpenSiteExplorer down?
I am trying to pull some data for a client and there are a bunch of redirects going on until I get a message from Safari that says too many redirects are happening. Any idea on what is going on? Need this info asap...
Moz Pro | | smulto0 -
How Old is OSE link data?
I ran an anchor text report for my client today, which shows that their site has some incoming comment spam links using totally unrelated phrases (pharma products). However, when looking for the live link, the linking page no longer contains the link to them. Maybe the webmasters removed these, but I can't track down a single one... how old is this data? thanks
Moz Pro | | JMagary0 -
Strange Links in OSE
Hey seomozers, The most recent Linkscape update has created some strange links to our domain. They are links which when I navigate to are download links, here is one example: http://mirror.centos.org/centos/4.9/updates/x86_64/headers/kernel-largesmp-0-2.6.9-89.0.25.EL.x86_64.hdr Now this links has nothing to do with our site and I can't see how it would count as a link to our domain, can anyone shed some light on why these types of links are being crawled as a link to our domain? Thanks Nigel
Moz Pro | | NigelJ0