Local listings aren't being crawled?
-
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO.I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled.
I will say that some local listings do appear on very few reports, but far not all of them.
So, what can be the problem?
-
Hi Charles. I don't work for Moz, so my recommendations are my own.
Also, I pay for a pro subscription here as well, and also combine resources from multiple sources when I'm really trying to get into the minutae of each and every back link. Ultimately it's a lot cheaper than creating my own crawler and index to try and duplicate Google. In your example with clients on local, you were likely involved in developing those links so why not keep track of them in-house versus 3rd party tools? Personally my only need I have for trying to get 100% of backlinks reported is if I run into a situation with a manual action client and need as robust as a disavow list as possible. Often times you can find these sorts of links via Google searches alone due to repetitive exact match keyword usage.
The most value I get out of OSE is when I'm comparing the back link profiles of my sites versus those of the competition that are appearing in the rankings. I can usually come up with more than enough work to keep myself busy when using the tool in this manner.
If you're specifically trying to manage local listings, Moz Local may be a better tool for your purposes. Cheers!
-
Thanks for a response.
Your answer does make sense, besides one thing:
We are paying MOZ for PRO subscription and instead of providing fully operational tool, I am being referred to other services?!
That's nice...
Everybody knows that GWT is very incorrect on many-many-metrics, ahrefs and majestic are not free (or at least not full versions of their tools). Hoping to get the most relevant results and SEO picture, we go with MOZ and that's what we get?! "Go check out other services"?
Shame... shame...
-
Hi Charles. It could be that due to Mozscape going after a wider diversity of domains, they're not crawling as deeply where your clients have local links. Here's Rand's explanation from the Jan 27 update:
The second is that we crawled a massively more diverse set of root domains than ever before. Whereas our previous index topped out at 192 million root domains, this latest one has 362 million (almost 1.9X as many unique, new domains we haven't crawled before). This means that DA and PA scores may fluctuate more than usual, as link diversity are big parts of those calculations and we've crawled a much larger swath of the deep, dark corners of the web (and non-US/non-.com domains, too). It also means that, for many of the big, more important sites on the web, we are crawling a little less deeply than we have in the past (the index grew by ~31% while the root domains grew by ~88%).
Bolded for my emphasis. If you cross link from your client sites to their local review listings to help / prompt users to fill out reviews you're likely to see more of those pages indexed in OSE. However, they could still be not counted if they're not considered important enough for that domain, i.e. if they're not in the top 1000 Yelp pages on yelp.com (numbers are just for example purposes of the idea... not accurate). Make sense?
Google however still likely knows about the links and is applying the related associations. And feel free to use other tools (GWT, aHrefs, Majestic) when trying to create a complete backlink profile for clients. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I copy a list a of keywords that I have manually selected in the KW explorer?
I am analyzing the keywords of a competitors, but only a bunch will be relevant for me, how can I manually select those I want to export?
Link Explorer | | Anagg0 -
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
Using Link Tracking list to track 301 backlinks for my main site backlink profile?
Greetings, I am utilizing link tracking list to keep a track of 301 redirect backlinks to my main site because these links do not as yet show up in my backlink profile on Moz. Will adding these to the tracking list with the redirected domain as the target / source url show up in my main site backlink profile eventually?
Link Explorer | | AkiedoFung0 -
Crawl a node js page - Why can I only see my frontpage?
Hi When i am trying to crawl my website ( https://www.doorot.com/ ) it can only find my frontpage. It's a node js page. Any one had the same problem or know how to crawl my site in order to see all my pages? Kasper
Link Explorer | | KasperClio1 -
Where can I see the list of the new backlinks reported?
In my dashboard I see a +875 in external links. Now they are 1,130. This sounds worrying rother than good news! I'd like to get an explaination but how can I see where these links come from? And when? How can be explained a steep increase in the link count from the last index? Also, a minor question, where can I find the increase percentage? I am able to see only the absolute count.
Link Explorer | | 2mlab0 -
Moz crawling bot
Hi guys, in OpenSiteExplorer -> Top Pages, there are no page titles displayed in a raport for certain domain, and "HTTP Status" column shows: "Blocked by robots.txt". I tried to find out what the ID of Moz crawling bot is, and on this page: http://moz.com/community/q/seomoz-spider-bot-details someone says it's: Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot). However, my robots.txt doesn't have such entry. Take a look: Automatically banned scanners and crawlers section User-agent: 008 Disallow: / user-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: metajobbot Disallow: / User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: fyberspider Disallow: / User-agent: dotbot Disallow: / User-agent: MojeekBot Disallow: / Section end What could be the problem here, then? Why does the Moz bot think I'm blocking it?
Link Explorer | | superseopl0 -
Is there an option that's more precise over Open Site Explorer?
I've had folks explain to me before that OpenSiteExplorer is just an estimation, etc. but there are some fairly easy statistics that seem to be different and it makes me nervous that either its wrong or I'm doing something wrong. As you can see in the image, moz isn't read social metrics correctly. It actually used to be pretty spot on, but as you can see with Google+'s its off. Maybe not a big deal right? But for my clients new Moz Analytic print outs it makes somewhat of a difference. Any help? UlwQs3w
Link Explorer | | jonnyholt0