Links counted in Google Webmaster Tools vs. OpenSiteExplorer
-
Hi all SEOmozzers,
site: http://f8phototravel.pl
I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other.
They are not present in OpenSiteExplorer.
Any ideas why?
Thanks,
Marek
*/ Alexa rank (Poland/Global)
-
Thanks Cyrus,
I need explanation how OSE works. Now know it and can wait for next results and work on good link connections. I will try to "flow to surface" with links from good sites in which I have buried links
Marek
-
Marek,
In the past, each Linkscape index started with the top 10 billion urls from the previous index, based on authority, and links were discovered outward from their. Today the process is similar, but the crawling proceeds on a more continuous basis.
Basically, Linkscape still has to discover URL through links. If there are not many linked paths from the top 10 billion URLs to a particular page (even if that page is on a high authority site) then Linkscape won't consider it a priority to crawl.
On the other hand, if there are short, clear routes to a URL, this means even if the page is on a low authority site, it might get included in the index. This is a more natural crawling system that, although not perfect, mimics the way authority is passed in the real world.
-
Thank you Ryan,
Great explanation. My idea is to make sure how it works and thanks to you i'm enlightened. I always try to understand mechanisms and rules of tools actions.
Thank you again:-)
Marek
-
OSE is based upon Linkscape's crawl of the web. The Linkscape crawl cycle is roughly a month. It takes 2-3 weeks to crawl the web, and then 1-2 weeks to process the large amount of data and provide it in a readily usable format.
When working with OSE it's important to know the Linkscape update schedule. OSE was last updated Jan 17th and will be updated again Feb 29th.
It's also important to understand how the crawler works. If you create a link during a period, you will often need to wait until the next period until the link is visible in OSE. I find OSE to be a fantastic tool for analyzing a site's backlinks. It takes time for OSE, Majestic or any other tool to crawl trillions of web pages and process the data. The tools will always be behind in the foreseeable future.
OSE is being adjusted to crawl deeper. In the past, it only crawled the top 25% of web pages. For the most part, if OSE does not see the link, the link likely has no value.
**I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other. **
Where is the linking page located within these sites? When were these links created? Those are the most relevant questions.
DMOZ is a PR 10, DA 10 site. Some pages are buried so deeply that neither Google or OSE crawls them.
In most cases, if a link is not discovered in OSE it is either two new or too weak (including buried links). If you feel neither is the case, you can submit the link information to help@seomoz.org and the help desk team will assist you.
-
Yes I know majesticseo and I wrote about it some time ago in Q&A What do you use Majestic SEO for?
Frankly speaking my question was a little bit provoking. It's a large number of tools ... each of them cost a money - that can be a problem, not big but...
My question is also about how the OSE crawl the pages/links, how accurate it is and in the end how long it take to crawl e.g. 50% of links?
And still I'm wonder why it crawls low ranked pages and not to crawl high ranked pages on specific market/country?
I really want to understand what is the scheme of OSE crawling work.
-
Besides SEOmoz, I would recommend Majestic SEO http://www.majesticseo.com/
-
I would wait and see what OSE says on their next update on the 29th. It looks like OSE crawls those sites, so either they don't crawl deep enough (as deep as Google does), or your links are newer and just not updated yet.
As for a reliable crawl tool, I believe OSE is great, but here is a nice post on a few other international tool. (based on OSE data)
-
Hi Brent,
I know that, already read lots of Q&A and other stuff ... but the thing is that OSE indexed links from my few domains (C Blocks) and other links from very low ranked sites.
I wonder why it doesn't index links from e.g. Google +1 and other high ranked sites?
It's a second month of campaign and few crawls behind...
It can be an issue for other campaign I want to perform for my clients ... should I use different tool for link tracking?
On the other hand my mR = 5.1, mT = 5.69, PA = 33, DA = 20 and all factors increased heavily last 2 months. At the same time my PR = 3 (from PR=0, 2 months ago)
Thanks
-
Google's crawler has a separate larger database, crawl rate ect, than OSE.
OSE indexes monthly where as Google's index is updated more often than that.
In short, OSE is just a different "snapshot" of the net then Google's much larger database of the web
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My homepage is not getting indexed by google for some reason
My homepage http://www.truebluelifeinsurance.com is not indexed by google. The rest of my site is indexed. The hompage is indexed by bing. I looked in the webmaster tools and there is no indication why. I believe the issue started when I did a site re-design in August. Any ideas?
Moz Pro | | Brian_Greenberg0 -
Used a free WP theme and now Webmaster Tools has shown hundreds of broken links
Hello everyone, We've recently launched two new music instrument listing websites. One in the US http://www.yourinstrument.com One in AU http://www.yourinstrument.com.au While we're waiting for our custom, branded WP to be built, I went and put up one of the free themes with closely matching colors. Clearly, this was a mistake because now my WMT account has spit out around 200 'not found' errors and my Moz account is calling them around 282 'dupe page titles' and 'content'??? 1. Aren't WP outbound links supposed to be 'nofollow' ? / Why is my theme creating strange links? 2. Can I clean all these up with assigning rel=canonical to the original blog post? Do I need to wait for the new theme to be installed and then 301 the random URLs found by Moz and WMT ? weird link examples: http://imgur.com/Cm6pO5H Please help 😕
Moz Pro | | Beetlebum0 -
Are the SEOMoz queries banned by Google?
Hi: In our company, we have notified that Google is banning our IP due to massive queries under the same IP. It is caused mainly by local softwares installed in PCs or some plugins of Firefox. We think that SEOmoz don´t causes this due to its tool uses its own IP and servers, not ours. We would like your opinion about this. Thank you,
Moz Pro | | Equipo_SEO_HUB_Interaction0 -
Is the on page optimization tool not working?
i received a grade f for one of my keywords/page. i corrected some of the points but when i tried to submit the form again, it doesn't check off those corrected items. is there something wrong with the tool right now? also, how does the tool work if i'm targeting 2 different keywords for one page? e.g. digital marketing philippines and digital marketing agency philippines I'm pretty sure one of the keywords will have problems with at least 3 critical and high importance on page factors (broad keyword usage in page title, exact keyword usage in page title, etc.) is there an effect if there's a critical factor left unchecked because using both keywords in the title might look redundant?
Moz Pro | | optimind0 -
Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools
Hi Guys, We're new here and I couldn't find the answer to my question. Here it goes: We had SEOMoz's Roger Crawl all of our pages and he came up with quite a few erros (Duplicate Content, Duplicate Page Titles, Long URL's). Per our CTO and using our Google Webmaster Tools, we informed Google not to index those Duplicate Content Pages. For our Long URL Errors, they are redirected to SEF URL's. What we would like to know is if Roger is able to know that we have instructed Google to not index these pages. My concern is Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools? Thanks so much, e
Moz Pro | | RichSteel0 -
Links not appearing on Open Site Explorer
My site gained several new inbound links during December and only two of them are not all showing up on the latest Linkscape update. It seems to be the links that were created at the end of the month which are showing up, whereas a handful at the beginning of the month are nowhere to be seen. All the linking pages have been indexed by Google the links are do-follow, and one of the sites in particular is not obsure and has a DA in the 90's. I appreciate the Linkscape doesn't index everything, but I would have thought that more tof the results of my efforts would have shown up in OSE. I'd be really grateful if anyone could explain this to me please. Thanks Ben
Moz Pro | | atticus70 -
SEO Moz Tools - too many on the page links result driving me nuts
A while back I remember Rand and I having a conversation about how many links on the page and up until that point I had followed the NO MORE THAN 100 links on a page rule - which is what the MOZ tools are telling me now in the campaigns I have running. But then during a seminar both of us were holding this 100 link rule question came up and Rand commented that this was probably old hat now as the search engines can crawl a much greater number of links in the page. I was encouraged by his answer especially where ecommerce websites are concerned. But the MOZ tool is driving me nuts telling me that this 100 link rule is still something to be adhered too. It is especially frustrating when we are discussing ecommerce website sites with editable mega menus. Examples to support this question are www.bohemiadesign.co.uk or www.flowersbuydelivery.co.uk which are 2 ecommerce sites I am aware of using such mega menus that are editable and give a link count greater than 100. and I am sure there are many more sites like this, even Amazon for example. So, how much notice do we take of this warning in MOZ tools that is telling me about excessive numbers of links on the pages it lists as needing corrected?
Moz Pro | | ICTADVIS0 -
Competitive link finder not working
Hi guys, I just wanted to check the status of the Competitive Link Finder. I've been trying to use it for well over a week, literally trying it every day and every single time I get the "we may be a little busy" message. Are there any plans to upgrade it? I realise its a labs tool, but its actually a really useful tool which I just don't seem to be able to benefit from whatsoever. Would love to hear what the plans for this tool are. Thanks Al
Moz Pro | | dotcentric0