Local listings aren't being crawled?
-
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO.I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled.
I will say that some local listings do appear on very few reports, but far not all of them.
So, what can be the problem?
-
Hi Charles. I don't work for Moz, so my recommendations are my own.
Also, I pay for a pro subscription here as well, and also combine resources from multiple sources when I'm really trying to get into the minutae of each and every back link. Ultimately it's a lot cheaper than creating my own crawler and index to try and duplicate Google. In your example with clients on local, you were likely involved in developing those links so why not keep track of them in-house versus 3rd party tools? Personally my only need I have for trying to get 100% of backlinks reported is if I run into a situation with a manual action client and need as robust as a disavow list as possible. Often times you can find these sorts of links via Google searches alone due to repetitive exact match keyword usage.
The most value I get out of OSE is when I'm comparing the back link profiles of my sites versus those of the competition that are appearing in the rankings. I can usually come up with more than enough work to keep myself busy when using the tool in this manner.
If you're specifically trying to manage local listings, Moz Local may be a better tool for your purposes. Cheers!
-
Thanks for a response.
Your answer does make sense, besides one thing:
We are paying MOZ for PRO subscription and instead of providing fully operational tool, I am being referred to other services?!
That's nice...
Everybody knows that GWT is very incorrect on many-many-metrics, ahrefs and majestic are not free (or at least not full versions of their tools). Hoping to get the most relevant results and SEO picture, we go with MOZ and that's what we get?! "Go check out other services"?
Shame... shame...
-
Hi Charles. It could be that due to Mozscape going after a wider diversity of domains, they're not crawling as deeply where your clients have local links. Here's Rand's explanation from the Jan 27 update:
The second is that we crawled a massively more diverse set of root domains than ever before. Whereas our previous index topped out at 192 million root domains, this latest one has 362 million (almost 1.9X as many unique, new domains we haven't crawled before). This means that DA and PA scores may fluctuate more than usual, as link diversity are big parts of those calculations and we've crawled a much larger swath of the deep, dark corners of the web (and non-US/non-.com domains, too). It also means that, for many of the big, more important sites on the web, we are crawling a little less deeply than we have in the past (the index grew by ~31% while the root domains grew by ~88%).
Bolded for my emphasis. If you cross link from your client sites to their local review listings to help / prompt users to fill out reviews you're likely to see more of those pages indexed in OSE. However, they could still be not counted if they're not considered important enough for that domain, i.e. if they're not in the top 1000 Yelp pages on yelp.com (numbers are just for example purposes of the idea... not accurate). Make sense?
Google however still likely knows about the links and is applying the related associations. And feel free to use other tools (GWT, aHrefs, Majestic) when trying to create a complete backlink profile for clients. Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
I couldn't check Page authority or Domain Authority for any page, what can be reason?
I am trying to check DA and PA for page but not able to do this. Tried it before two days and it was working fine, problem occurring today. I want help regarding this issue, is anyone other facing this problem. Kindly help me out (provide some other way to check DA/PA).
Link Explorer | | JessicaThompson1 -
OSE 'request CSV' for links blank
After doing the link check on a domain, got 40 or so links. Clicked Request CSV The file that is downloaded contains no links. The column headings are there but no content Did this twice and got same blank file. OSE is showing the 40 links
Link Explorer | | cbpayne0 -
Get a List of Pages in a Site, Ranked by their PA?
Is there a way to get a list of the pages within one of my sites, and rank it by page authority?
Link Explorer | | JDigitalIdentity1 -
Why is Moz not crawling my backlinks
Hi my website www.dealwithautism.com is 3 months old and has been on DA 1 and PA1 ever since, even though the site is actively developed with quality content (a couple of posts already have 1k+ fb likes acquired editorially, while that doesnt necessarily improve SERP, it sure tells you that the post is engaging). In contrast another site of mine, www.deckmymac.com which is hardly ever managed, not have more than 15 posts and just 1 backlink, has DA 14. Running an on page analysis on www.dealwithautism.com I observed that Moz has not identified any backlinks nor social signals (except G+). However, according to Webmasters, I have 57 links, 51 of them to the root. Even Majestic is able to report 32+ backlinks. So what am I missing? Certainly, at this stage my website doesn't deserve DA 1, or does it?
Link Explorer | | DealWithAutism0 -
When requesting a CSV for an internal 302 redirect report, the data isn't aligning with the UI. Does anyone have any suggestions?
When requesting a CSV for an internal 302 redirect report, the data isn't aligning with the UI. Does anyone have any suggestions?
Link Explorer | | Merkle-Impaqt0 -
What if all the URL's in my website reported by MoZ do not exist on my website? They existed on an old one that has now been rebuilt?
What if all the top URL's report by Moz in my website do not exist on my website? They only existed on an older website? The only exception in the homepage
Link Explorer | | FCB0 -
How Is a Page Crawled by Moz When Moz Says 'No Links'?
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors. The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages. So how are these pages being crawled by Moz and what should I advise my client?
Link Explorer | | xerox4320