Links counted in Google Webmaster Tools vs. OpenSiteExplorer
-
Hi all SEOmozzers,
site: http://f8phototravel.pl
I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other.
They are not present in OpenSiteExplorer.
Any ideas why?
Thanks,
Marek
*/ Alexa rank (Poland/Global)
-
Thanks Cyrus,
I need explanation how OSE works. Now know it and can wait for next results and work on good link connections. I will try to "flow to surface" with links from good sites in which I have buried links
Marek
-
Marek,
In the past, each Linkscape index started with the top 10 billion urls from the previous index, based on authority, and links were discovered outward from their. Today the process is similar, but the crawling proceeds on a more continuous basis.
Basically, Linkscape still has to discover URL through links. If there are not many linked paths from the top 10 billion URLs to a particular page (even if that page is on a high authority site) then Linkscape won't consider it a priority to crawl.
On the other hand, if there are short, clear routes to a URL, this means even if the page is on a low authority site, it might get included in the index. This is a more natural crawling system that, although not perfect, mimics the way authority is passed in the real world.
-
Thank you Ryan,
Great explanation. My idea is to make sure how it works and thanks to you i'm enlightened. I always try to understand mechanisms and rules of tools actions.
Thank you again:-)
Marek
-
OSE is based upon Linkscape's crawl of the web. The Linkscape crawl cycle is roughly a month. It takes 2-3 weeks to crawl the web, and then 1-2 weeks to process the large amount of data and provide it in a readily usable format.
When working with OSE it's important to know the Linkscape update schedule. OSE was last updated Jan 17th and will be updated again Feb 29th.
It's also important to understand how the crawler works. If you create a link during a period, you will often need to wait until the next period until the link is visible in OSE. I find OSE to be a fantastic tool for analyzing a site's backlinks. It takes time for OSE, Majestic or any other tool to crawl trillions of web pages and process the data. The tools will always be behind in the foreseeable future.
OSE is being adjusted to crawl deeper. In the past, it only crawled the top 25% of web pages. For the most part, if OSE does not see the link, the link likely has no value.
**I have (in my GMT profile) 43 domains linking. Among them one of the biggest Polish like: onet.pl (5/187), gazeta.pl (8/393), grono.net.pl, canon-board.info, eturystyka.org and other. **
Where is the linking page located within these sites? When were these links created? Those are the most relevant questions.
DMOZ is a PR 10, DA 10 site. Some pages are buried so deeply that neither Google or OSE crawls them.
In most cases, if a link is not discovered in OSE it is either two new or too weak (including buried links). If you feel neither is the case, you can submit the link information to help@seomoz.org and the help desk team will assist you.
-
Yes I know majesticseo and I wrote about it some time ago in Q&A What do you use Majestic SEO for?
Frankly speaking my question was a little bit provoking. It's a large number of tools ... each of them cost a money - that can be a problem, not big but...
My question is also about how the OSE crawl the pages/links, how accurate it is and in the end how long it take to crawl e.g. 50% of links?
And still I'm wonder why it crawls low ranked pages and not to crawl high ranked pages on specific market/country?
I really want to understand what is the scheme of OSE crawling work.
-
Besides SEOmoz, I would recommend Majestic SEO http://www.majesticseo.com/
-
I would wait and see what OSE says on their next update on the 29th. It looks like OSE crawls those sites, so either they don't crawl deep enough (as deep as Google does), or your links are newer and just not updated yet.
As for a reliable crawl tool, I believe OSE is great, but here is a nice post on a few other international tool. (based on OSE data)
-
Hi Brent,
I know that, already read lots of Q&A and other stuff ... but the thing is that OSE indexed links from my few domains (C Blocks) and other links from very low ranked sites.
I wonder why it doesn't index links from e.g. Google +1 and other high ranked sites?
It's a second month of campaign and few crawls behind...
It can be an issue for other campaign I want to perform for my clients ... should I use different tool for link tracking?
On the other hand my mR = 5.1, mT = 5.69, PA = 33, DA = 20 and all factors increased heavily last 2 months. At the same time my PR = 3 (from PR=0, 2 months ago)
Thanks
-
Google's crawler has a separate larger database, crawl rate ect, than OSE.
OSE indexes monthly where as Google's index is updated more often than that.
In short, OSE is just a different "snapshot" of the net then Google's much larger database of the web
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Listing of all Google Indexed Pages
I started managing a site that has about 391,000 indexed pages. I want to get to the bottom of why there are so many in preparation for a ecommerce Migration and improving SEO. Anyone know of a tool? Many tools I have came across can only take 100 at a time. I would love to get them in excel or a database. I look forward to the suggestions.
Moz Pro | | dhands170 -
Is there an external tool to check for Link Balance profile (anchor text)?
Hi, Regarding the topic of Link Balance (anchor text from external sites). Is there an external tool you can point to your site or an individual URL that can give you the link balance (branded terms, exact match etc). This article is great:
Moz Pro | | STL
http://moz.com/blog/anchor-text-distribution-avoiding-over-optimization But it's a lot of work to do for individual pages (of which we have many). Just trying to see if there's a tool out there (Moz or otherwise), that can report on such balance on a page-by-page basis (paste in URL, hit 'Go'). Thanks.
Rich Talbot0 -
Google Local results ranking
Are Google Local position results included in Moz ranking reports? If not, how can these be tracked and monitored? Is a Google Local result likely to achieve a similar CTR as previous organic results? Some of our previous good organic search rankings seem to have been replaced by Google Local results for our restaurant and hotel clients. Is this likely to achieve the same traffic and if not, is there a way to get back to organic results? Thanks!
Moz Pro | | ignitehospitality0 -
Re: Competitive Link Comparison
In Competitive Link Comparison Top 5 contenders... why would the landing page have an HTTP Status showing as Blocked by robots.txt when it is not blocked within the robots.txt file and no files are shown as blocked in Google's webmaster tools. Sorr if I've ticked the incorrect topic categories
Moz Pro | | Hornblower0 -
How to find the authorities site to link from
Hi It seems getting quality authority backlinks is the main priority to success in your SEO which is also most difficult task as well . How do you find these authority sites that allows you to backlink from them? is there any tools to find good quality sites for backlinks? Thanks
Moz Pro | | Matt-kind0 -
Integration of Google+, LinkedIn, YouTube?
I ran across a blog on Moz from last November that was introducing the social monitoring feature. It mentioned adding new social platforms that would eventually be included in SEOMoz. Any word on when/if that is happening? Excited to have SEO and Social under the same dashboard! Jake
Moz Pro | | AESEO2 -
Getting relevant keywords from URL with Google KW Tool.
Hi, When I first start researching a site, I like to see what Google "thinks" it is relevant to. I use the Google KW Tool and enter the website URL only. I sort the results by relevance. I can then show the prospective client what Google thinks his site is optimized for and use that info to show him what opportunities exist to rank for terms more relevant to his business. I show him keyword, volume and I also get current SERP rank for his site. For larger sites, I do this for the top pages based Domain Authority. I want to automate this process using excel and APIs but Google refused my API token request. I told them I wanted to use the "Google AdWords API Extension for Excel" from http://seogadget.co.uk/google-adwords-plugin-excel. The Google API token team replied: Please note, after reviewing your application in detail, we are sorry to let you know that we won't be able to approve your token. We understand that you are planning to use the AdWords API mainly for Targeting Idea Service (TIS) and Traffic Estimation Service (TES) such as 'keyword research'. Please note that as per the Required Minimum Functionality (RMF) outlined in the API Terms & Conditions, using the AdWords API exclusively for TIS and TES type of services is not allowed. Q1: What does the KW Tool relevancy data mean, anyway? Q2: is there another way to get it or is there another way to do this? Q3: Is there a better approach I should take with the Google API team? Q4: Are there other APIs and Excel plugins that can do this, including the SEOMoz APIs? Thanks,
Moz Pro | | phersh
Phil0 -
Need assistance with tool development using SEOMoz & Google APIs
I don't know where the right place to ask this is, but I work for an SEO agency, and we are looking for someone to help us with development of some tools utilizing the SEOMoz API and probably the Google API as well. Does anyone know where I could find a person with some previous experience with development using these APIs? We've had poor luck just trying to use a developer without specific experience in this area or at least some SEO knowledge. If you're a developer and would like to talk with us, you can contact me directly if you prefer, rather than post your contact info publicly, but I welcome any helpful thoughts or ideas regarding development of SEO tools. Thanks,
Moz Pro | | BandLeader
John
jmaher [at] mcdia.com0