Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to tell moz about the domain redirects?
If I redirected my previous domain to my new domain, how can I tell moz that the previous domain is redirected?
Link Explorer | | LannaRosse0 -
Our Domains DA has dropped from 52 to 17
Hi,
Link Explorer | | JudyLam
Our domain's DA (www.tricorglobal.com) has dropped drastically from 52 to 17 on Mar 2019. And has only gone up to 21 now. Is there a reason why this happened. On the other hand, our competitor's score has increased. Is there a valid reason for this? How can I find out what is hurting our DA and how can I fix this?1 -
Spam links and Domain Authority
I have a site that I know was Domain Authority 35 but now Domain Authority 25 after someone sent a load of spam links to it, how can this be correct and how can I change it? Is it worth doing a disavow and will moz take that into account?
Link Explorer | | BobAnderson0 -
Does moz pro standard give access to open site explorer & keyword explorer?
Does moz pro standard give access to open site explorer & keyword explorer?
Link Explorer | | SearchOpt1 -
Weekly and other data not available in moz tools
Dear All, Since last few days we are not getting updated results in moz tools. We get following warnings in the pages. "Hello! Weekly data for some campaigns is a bit behind schedule. Don't worry; it's processing now and will be available soon. Check out http://health.moz.com for the latest status on all of our tools. And thanks for your patience!" How much time it will take to show us the current results, so that we can properly work on it. Right now we are not able to measure any changes affected our site. Thanks, Om
Link Explorer | | omverma0 -
Quality/Established blog showing DA1 PA1 on OSE
Hello there, We have come across what looks like a high quality blog in our niche (interior design). The blog has been established for a while and is well designed. The content is of a good quality The blog URL: http://www.apartmentnumber4.com The blog has a good following across its social media accounts. However, Open Site Explorer is showing DA1 and PA1 Does anyone know why that is?
Link Explorer | | roberthseo0 -
How often the the domain authority checker update?
How often does the domain authority checker update? I added a lot of backlinks over the last month or so, but I don't see any of them through the checker.
Link Explorer | | studio35design4 -
Updating OSE data
Hello Moz, I was wondering if anyone knows how Moz goes about updating their OSE data? I've been doing some link building that past couple of weeks, and I notice that the number of "just discovered" links will update every time I gain a new link, however, the "Linking domains" number doesn't (or maybe, rarely) update. I've checked through the "Linking domains" list to see if the link is there, but none of the links I've just recently obtained have shown up under that metric. Does anyone have any insight on this or is anyone experiencing the same issue? Thanks for reading!
Link Explorer | | GalcoIndustrial1