How Is a Page Crawled by Moz When Moz Says 'No Links'?
-
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors.
The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages.
So how are these pages being crawled by Moz and what should I advise my client?
-
Thanks again, Peter.
-
That's great, thanks Keri.
-
Hi, no problem. Keri has answered your query re the Moz crawler not finding them.
Peter
-
If you download the CSV report, we list the referring page there. We know it isn't obvious and we're working on making this a little easier to find.
-
Hi Keri,
Thanks for getting back to me (thanks to Peter above, also).
So what is the best way of me finding where these 404 pages are linked from?
I am 99% sure they are internal links that I will ask the client to remove, but would like to avoid manually checking every link on the site if possible.
-
Hi Peter,
I searched for their domain name and about the expected number of results came up.
I searched for these individual URLs that Moz is reporting using the site: command, and they were not returned.
They are also neither in the site's sitemap (HTML page or XML file).
So how is SEOmoz Crawler finding them?
-
We have two completely different crawling systems. We have on crawler for your website, where you enter in your URL and we crawl your site looking for problems. We have a different crawler for OSE that goes and looks at the web in general and crawls for links. The two crawlers do not talk to each other, so it is actually understandable that OSE may not have data on the site. OSE doesn't have the same index size as Google, so we don't see all the links that are actually out there (though we're working all the time on improving this!).
-
Hi, if you put site:xxx.com into Google where xxx.com is your client's domain name, does Google report anything?
Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is my backlink not detected here, but it appears on google search console? I have added the moz robots
Why is my backlink not detected here, but it appears on google search console? I have added the moz robots
Link Explorer | | gunawanjord0 -
I build DA from 15 to 26 in 45 days, but now it stop. We have links from 50+ high authority websites and building more.
Hi Team I build my website domain authority from 15 to 26 points in the last 2 months. We getting links from high DA traffic websites all across the globe through guest posting. We grow from 34 linking domains to 155 in this duration(45days) and still, we are working on getting quality links through authority websites. My DA stops on 26 which is not growing for last 2 weeks. Please share your views on it. Thanks in advance
Link Explorer | | AtulSharan1 -
Low Internal Equity-Passing Links: Open Ste Explorer Issue
Does anyone know why Open Site Explorer shows so few Internal Equity Passing Links? When a page is part of the main navigation of a website and the website has over 3500 pages indexed in Google with high DA's why would the Open Site Explorer number be so low? I have run scans on other tools and see a much larger number than OSE reports. Thoughts? Has anyone else ever experienced that?
Link Explorer | | slangdon0 -
804 error preventing website being crawled
Hi For both subdomains https://us.sagepub.com and https://uk.sagepub.com crawling is being prevented by a 804 error. I can't see any reason why this should be so as all content is served through https. Thanks
Link Explorer | | philmoorse0 -
SEO report for specific pages (not just based on keyword analysis)
Hi, i am after a report where i can type in a URL nd get SPECIFIC details on how to exactly optimise a SPECIFIC page (not just the home page) for better organic results. A complete overview to everything in relation to tags, images tags, headers etc etc. I am yet to find the ability to get such a report with your service. COudl you please advise how i can do so. Thanks
Link Explorer | | andrewlos0 -
May I know multiple campaigns set up, with same site url is allowable in Moz campaign or not?
Hi Guys, I have a question regarding moz campaign. I am a Moz Pro member, have taken Standard Plan. (Time being, am not in a position to upgrade to a higher plan) I have utilized only one campaign slot among total 5 slots. I have added xyz.com website in one campaign, there I have added 350 keywords which is the maximum count we can add in a a single campaign. Still, I have plenty of keywords to track for same website xyz.com. I am not planning to use the remaining 4 campaign slots for time being for any other websites. May I know, if I can add same xyz.com website in remaining campaign slots for tracking the remaining keywords for my website?
Link Explorer | | zco_seo0 -
Open Site Explorer Only showing 2 Internal Links
Hi, for some reason Open Site Explorer only shows 2 internal links linking to our homepage (and other pages). When looking at a competitors site, they have thousands of internal links to their homepage! Are there any reasons why OSE is only showing 2 for our site, when in fact there are hundreds and thousands? Thanks.
Link Explorer | | Jaybeamer0 -
What is the difference between a "Just Discovered" link and an "Established" link in OSE?
What is the difference between a "Just Discovered" link and an "Established" link in OSE? How long does it generally take for a just discovered link to migrate in to the established link section? Are there other parameters that need to be met before a link can be referred to as established? Sorry for all the questions in one post, but I've had the same "just discovered" links in OSE for quite some time and have yet to see them migrate over to the "established" link section. I was hoping that when these links become established that it would help improve my site DA. Can anyone shed any light on this issue or have any other comments? Thanks MOZ!
Link Explorer | | GalcoIndustrial1