Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How do I find http backlinks to my domain?
Hi, We spotted a number of sites linking to us from http sites, not https sites. How can I use backlink tools to find just those from http sites? Right now I'm looking at exporting a spreadsheet with 3.3 million entries and filtering - and there's not one person here who wants to do that! Thanks in advance. Screen Shot 2021-11-03 at 10.49.12.png
Link Explorer | | mark_seomoz10 -
MOZ DA IS NOT INCRAESING
Hey my website on business cards its DA is not increasing. is there any way to increase its DA.
Link Explorer | | cartwrightkar0 -
Moz was unable to crawl your site on Jun 22, 2020\. We were unable to access your site due to a page timeout on your robots.txt, which prevented us from crawling the rest of your site.
Site: www.kpmg.us Getting robots.txt timeout fail since 02/29/20. We've checked our server logs and see no errors. Went through all the steps of the "Troubleshooter". Updated robots.txt to allow rogerbot full access: User-agent: rogerbot
Link Explorer | | KPMG-Search-Social
Disallow: Any ideas how to get roger to crawl my site????1 -
How MOZ OSE Work and calculate Compare Links Metrics ?
I want to know everything about compare links metrics. Like how Moz work and calculate this value of Internal Equity-Passing Links External Equity-Passing Links Total Equity-Passing Links Total Internal Links Total External Links Total Links in each metrics ( Page Specific Metrics: Subdomain Metrics: Root Domain Metrics: ) Each metrics Show different value for same metrics.
Link Explorer | | HuptechWebseo0 -
Does Domain Authority Consider Social Signals?
I was curious if Domain Authority considers social signals. "We calculate this metric by combining all of our other link metrics—linking root domains, number of total links, MozRank,MozTrust, etc.—into a single score." Is Social included in the etc? I know you have some social data displayed in the results.
Link Explorer | | eyeflow1 -
When is OSE updated?
Hey there, It clearly stands that OSE will be updated, well yesterday... on 21th April. In my experience, they usually update the date if they have technical issues or something... ...but now they haven't yet made any changes.
Link Explorer | | Kokolo0 -
Why Moz doesn't offer tool similar like SEOprofiler Link Disinfection?
Hi Moz, As I have been your member & using pro tool for more than an year, it's been amazing experience working and using your each tool's function tool, wehther to check on-page grader, rank tracking, on-page crawling issue, keyword difficulty and the one my best for link analysis is Open Site Explorer etc. I came here to ask about something which I didn't find here than other providers is most popular Bad Link Detection Tool. As **SEOprofiler Link Disinfection **offers their customers to use this to get all of their bad or spammy links harming them to rank high or getting away from ranking goal. Let me know, are you planning anything similar to this to bring soon in your tools and provide your members to take benefits of such type function as well OR should i go to SEOprofiler for this? Best,
Link Explorer | | Futura
Teginder Ravi0