Can I get a list of all links on a given domain?
-
Sorry, this is actually kind of a tripartite question:
I was looking at the Competitive Link Analysis on one my clients' campaigns. Sometime between June and September their total links went up by about 120,000. We have no idea where those links came from (although the numbers would indicate that they're mostly internal).
Question 1: In none of the other tools can I figure out how to list these links on a domain level. Is there a way to get a list of all links for our given domain?
I've been playing around with the page-by-page and even that doesn't show me everything. For example, I'm looking at OSE for their homepage and it lists 45 links for a page that it claims has 151 total.
Question 2: How did it pick those 45 to display out of the 151 possible? If these are only external links, why do half of them come from one of our subdomains?
Also...
Question 3: If our client hasn't made any major changes recently, why has the number of internal links gone up so dramatically?
Thanks.
-
Hi Bozzie,
Sorry to hear about this problem. I'd also suggest emailing the help desk and sending them a copy of your CSV so they can help you out.
Keri
-
I have also had the same issue of ose not exporting all the ones it said it found.
-
Ok. Thanks.
-
I'd email your information to the help desk at help@seomoz.org and include details about your search and a copy of the CSV in case this is a bug they need to look into.
-
Hey Bryant,
Thanks for answering my questions.
I do have a follow-up, if someone can help me out with this:
I went back and applied the "all links" "external" and "root domain" filters. OSE told me there were 368 results. When I exported them to CSV, however, it only returned 79.
Am I doing something wrong?
Thanks again.
-
Hi, Mackenzie Fogelson
This could have something to do with the recent linkscape updates talked about here and here. Basiclly, there have been some changes in how many sites ose is able to crawl, and how deep into the sites they crawl.
When you run a scan in OSE, you can always filter the results by "all links" ,"external", and "all links to the root domain" After you run this report try cross referencing it in Google Webmaster Tools, or Yahoo's site explorer tools.
Hope this help.
-Bryant
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Identifying Bad Domains
In the past week my website has not been doing well. How can I look at a list of domains linking to my website to identify which ones are harmful and need to be removed. Is there a checklist of criteria that a linking doamin to meet for me to remove it? Thank you for your help.
Moz Pro | | andrewlegal0 -
Rogerbot getting cheeky?
Hi SeoMoz, From time to time my server crashes during Rogerbot's crawling escapades, even though I have a robots.txt file with a crawl-delay 10, now just increased to 20. I looked at the Apache log and noticed Roger hitting me from from 4 different addresses 216.244.72.3, 72.11, 72.12 and 216.176.191.201, and most times whilst on each separate address, it was 10 seconds apart, ALL 4 addresses would hit 4 different pages simultaneously (example 2). At other times, it wasn't respecting robots.txt at all (see example 1 below). I wouldn't call this situation 'respecting the crawl-delay' entry in robots.txt as other question answered here by you have stated. 4 simultaneous page requests within 1 sec from Rogerbot is not what should be happening IMHO. example 1
Moz Pro | | BM7
216.244.72.12 - - [05/Sep/2012:15:54:27 +1000] "GET /store/product-info.php?mypage1.html" 200 77813
216.244.72.12 - - [05/Sep/2012:15:54:27 +1000] "GET /store/product-info.php?mypage2.html HTTP/1.1" 200 74058
216.244.72.12 - - [05/Sep/2012:15:54:28 +1000] "GET /store/product-info.php?mypage3.html HTTP/1.1" 200 69772
216.244.72.12 - - [05/Sep/2012:15:54:37 +1000] "GET /store/product-info.php?mypage4.html HTTP/1.1" 200 82441 example 2
216.244.72.12 - - [05/Sep/2012:15:46:15 +1000] "GET /store/mypage1.html HTTP/1.1" 200 70209
216.244.72.11 - - [05/Sep/2012:15:46:15 +1000] "GET /store/mypage2.html HTTP/1.1" 200 82384
216.244.72.12 - - [05/Sep/2012:15:46:15 +1000] "GET /store/mypage3.html HTTP/1.1" 200 83683
216.244.72.3 - - [05/Sep/2012:15:46:15 +1000] "GET /store/mypage4.html HTTP/1.1" 200 82431
216.244.72.3 - - [05/Sep/2012:15:46:16 +1000] "GET /store/mypage5.html HTTP/1.1" 200 82855
216.176.191.201 - - [05/Sep/2012:15:46:26 +1000] "GET /store/mypage6.html HTTP/1.1" 200 75659 Please advise.1 -
In my crawl diagnostics, there are links to duplicate content. How can I track down where these links originated in?
How can I find out how SEOMOz found these links to begin with? That would help fix the issue. Where's the source page where the link was first encountered listed at?
Moz Pro | | kirklandsl0 -
How can I get a report of the top 500 national sites using Domain Authority and Page Authority? Does someone have to type sites in one by one on Site Explorer or is there another way?
I want to know what sites and blogs have the to rankings overall based on their Domain Authority and Page Authority - Top 500 - 1000 in nation - I want to know which ones are follow and no-follow too - Does anyone know? Has anyone run such a report yet? Thanks for help - BD
Moz Pro | | creativeguy0 -
Increasing Domain Authority scores
Ok, a bit of a 'how long is a piece of string' type question this... Looking for the opinions of wiser users than myself in trying to work out how long is a realistic target for getting my domain authority somewhere near that of my competitors. I have been tracking my domain and three competitors in the campaign tool for a few months and they seem to average about 0.5 increase a month in their DA - they are averaging around 65 DA each. My site is currently DA 32, has increased from 21 in 5 months. Is this a decent rate of increase? How long would people expect it to take to increase a domain by 10, 20 etc? I know there are too many variables in the world of seo for a complete 'do this and this will happen' answer, but it's good to have a DA goal to work to, it acts as a good motivator for staff, especially when you begin to close in on competitors. Thanks, Carl
Moz Pro | | Grumpy_Carl0 -
Need a Google Doc That Imports List of Links From SEOMoz API
Does anyone have one they'd like to share. I've seen the great ones by Tom Anthony but I am looking for the list of the first 1000 links that are available as part of the free API to be brought back into a Google Doc.
Moz Pro | | belasco0 -
Domain Authority: Sites with lower numbers get higher ranking.
We had a question about your online tools for http://pro.seomoz.org/campaigns/30642 The Domain Authority for http://pucherinsurance.com/ is 67: Higher than most of our competitors such as <cite><cite>bluecross.ca which has a rank of 54. </cite> </cite> We show up lower in the actual search results. An example phrase would be Visitors to Canada health Insurance. We get an A grade for onsite reports and we are working on the duplicate content and titles. We appear to be doing everything right but still rank lower than expected. Any thoughts?
Moz Pro | | northerncs0