Anytime!
Cheers 
Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Posts made by DavidLee
-
RE: Why Open Site Explorer is Showing 0 Total Internal Links?posted in Link Explorer
Your robots.txt is blocking us with the wildcard directive at the very bottom.
You will want to add:
User-agent: dotbot
Disallow:This should update when we release a new index next month.
Hope this helps!
-
RE: Why Open Site Explorer is Showing 0 Total Internal Links?posted in Link Explorer
Hi Anirban!
OSE crawls differently from our diagnostics crawler so it doesn't quite follow the link structure within the source code unless we can reach the page through other important sites that are linking to you.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index.
Other times can be re-directs and javascript and server errors that would prevent access to the site. If you can tell me your domain name I would love to take a look.
Talk to you soon!
-
RE: MOZ for initial keyword research?posted in Getting Started
Hey Peter!
I replied to your email with some helpful links. I will change this to a discussion so others can provide some recommendations.
Cheers!