How can I create an accurate backlink profile?
-
With Google's emphasis on punishing over-optimization I would like to make sure I keep a close eye on my backlink profile. Link Detective is a great tool, however, for sites which I know have thousands of backlinks in WMT and MajesticSEO, OSE only finds a handful--maybe 10%. How can I trust the information I get from OSE to provide me with actionable data when the raw numbers of backlinks are so far off when compared to the other databases.
-
OSE only does crawl a portion of the web. We are trying to crawl more URLs, but also make sure our data is fresh. It's a bit of a massive undertaking to try to amass data at this scale.
Check out the blogpost for our May update at http://www.seomoz.org/blog/may-mozscape-index-update164-billion-urls for some more information about OSE, where we're at, and where we're going.
-
I have the same problem. I know my site is linked on a bunch more sites, but every month they don't show up in OSE and I just don't get why. Does OSE only grab a certain amount of the web? And if links to your site arn't in that percentage they just don't show up.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to manually create sitemap with 301 redirrctions?
Hi there I've just redirected a few of my pages (created in Dreamweaver) using the PHP Redirect function, I am wondering how do I create a manual sitemap to submit to Google to reflect this or will Google pick it up automatically based on the below? Example:
Technical SEO | | IsaCleanse
URL Being redirected: http://industrytix.com.au/cuban-club-perth-tickets.php **New URL: **[http://industrytix.com.au/buy-tickets/cuban-club-perth-nyd/ Redirect code:](http://industrytix.com.au/buy-tickets/cuban-club-perth-nyd/) Header( "HTTP/1.1 301 Moved Permanently" );
Header( "Location: http://industrytix.com.au/buy-tickets/cuban-club-perth-nyd/" );
?>0 -
Organizing A Backlink Authority Category Page
I work for a company that has many promotions throughout the year, some big, some HUGE. Typically they have created a landing page for this content. The issue is, when this promotion ends, we will kill the landing page, thus 404ing the backlinks and putting the page authority in purgatory. (1) What would be the best way the keep these pages organized? I was thinking about creating a main "Promotions" page with the current promotion on it (the previous ones linked on the bottom of the page). Then when the promotion ends I would copy those contents and add them to a new page and link to it from the original "promotions" page. An issue I see with this is that the promotions page would always have the same Title Tag and vanity URL. (2) This could provide many links to the "promotions" page over time to build it's authority, but would constantly changing content hurt ranking factors?
Technical SEO | | nat88han0 -
Http to Https Backlink Value
We updated our website from http to https and I wanted to know how backlinks were affected by this. The new site redirects all old http links to the https home page. How does this affect more specific backlinks like http://www.mysite.com/about ? The old http://www.mysite.com/about is now being directed to https://www.mysite.com . Do I need to set up redirects to pass value to my new pages?
Technical SEO | | nat88han0 -
Responsive Code Creating Duplicate Content Issue
Good morning, Our developers have recently created a new site for our agency. The site is responsive for mobile/tablets. I've just put the site through Screaming Frog and I've been informed of duplicate H2s. When I've looked at some of the page sources, there are some instances of duplicated H2s and duplicated content. These duplicates don't actually appear on the site, only in the code. When I asked the development guys about this, they advised this is duplicated because of the code for the responsive site. Will the site be negatively affected because of this? Not everything is duplicated, which leads me to believe it probably could have been designed better... but I'm no developer so don't know for sure. I've checked the code for other responsive sites and no duplicates can be found. Thanks in advance, Lewis
Technical SEO | | PeaSoupDigital0 -
Disavow a big part of my external link profile
Hi There, With the latest penguin 3.0 algorithm update (on October 17th,) I noticed a drop in my rankings. Even though I didn’t receive any manual penalty because no messages have been found in WebMaster Tool, I suspect it is an algorithm penalty. For this reason, I definitively decided to clean-up my external link profile. **I am excluding it is a Panda 4.1 penalty because an extensive site structure review has been conducted quite recently. I collected external links from Webmaster Tool and Open Site Explorer. What I found is that 83% of my external links need to be disavowed because the links come either from poor directories or marketing articles that are evidently and specifically written for link building purposes. My questions are: 1) Shall an external link clean-up be set in place anyway although I didn’t receive any penalty message in order to prevent future problems with penguin algorithm? 2) Is it too dangerous to disavow 83% of external links? May such a manoeuvre destroy my actual rankings? Thanks in advance for you advices 🙂
Technical SEO | | Midleton0 -
Links from PubMed (nlm.nih.gov) not appearing in backlinks for articles
Content from our medical journals gets indexed by the National Library of Medicine / PubMed on a monthly basis. The link to the full article appears in the upper-right corner on PubMed, yet I'm unable to find PubMed (nlm.nih.gov) backlinks in the reporting tools. Example:
Technical SEO | | aafpitadmin
Article Title: Respiratory Syncytial Virus Infection in Children (allintitle query)
Article URL: http://www.aafp.org/afp/2011/0115/p141.html
PubMed URL: http://www.ncbi.nlm.nih.gov/pubmed/21243988 The PubMed link is to http://www.aafp.org/link_out?pmid=21243988 ,
a 301 redirect to the article, http://www.aafp.org/afp/2011/0115/p141.html Any idea why this link isn't appearing in backlinks? This isn't just for one article, we have roughly 2,000 articles from 1998 to the present. Articles from the past 12-months are access-restricted, and after 12-months the articles become public.0 -
Can spiders crawl jQuery Fancy Box scripts
Hi Everyone - I'm not a technical person at all. I have some content that will be hidden until a user clicks "learn more" where upon it will be displayed via jQuery Fancy Box script. The content behind the learn more javascript is important and I need it to be crawled by search engine spiders. Does anyone know if there will be a problem with this script?
Technical SEO | | Santaur0 -
How do I create an RSS feed for my site?
I do NOT have a cms website. just php/html. How do I create a feed so I can register it with feedburner? Not for my blog just the website its self.
Technical SEO | | bozzie3110