Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
-
Hi all,
Moz cannot crawl the domein http://www.hoesjescases.nl.
When I open the crawl report I only see one line:<colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 |Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains.
Google seems not to have any problems. What can be the problem for MOZ?
Greetings!
-
I have the same issue with my website: www.hoes.be
-
Thanks! I'll do that.
-
Hey There!
I'm sorry that you are having some trouble getting your site crawled. We are actually finding links in our index to unplag.com, because these links are found by crawling other sites rather than your actual site. However, we are unable to provide crawl diagnostics within your campaign because we are receiving a 400 bad request error from the site. You can also see that response using this header checker tool here: http://www.webconfs.com/http-header-check.php
In order to figure out why your site is returning this response, you would need to have your hosting provider investigate into your server.
I hope this helps! Please let me know if I can help you with anything else.
-
Hello everyone.
I have the same issue with unplag.com. Both on-page grader and website crawl are not working.
Yes, I have tried different urls.
According to Charles Mazzie - moz index changes once a month so the problem can occur because a week ago I had Rogerbot disallowed in robots.txt.
Also, moz guide says that sometimes cookie policy of my site may cause RogerBot buzzing.
Unfortunately I still haven't solved the problem. So if you can - please help.
-
Hey There,
It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.
I hope this helps! Please let me know if I can help you with anything else.
Chiaryn
-
Yes, I see the same results.
If you're expecting to see more and wondering why not, that's a topic that frequently comes up in this forum. Here's one good explanation from member Charles Mazzie - https://moz.com/community/q/inbound-links-how-accurate-or-up-to-date-is-open-site-explorer. There are others you can find by searching Q&A.
-
You sure you don't just have a typo in the URL? I just tried running your domain thru open site explorer and couldn't replicate the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Link Explorer | | dlwnsh05100 -
Moz bot transforms special characters into fake 404 Pages in Reports
I have a lot of 404 links in my exported Moz Pro reports which are not actually Not Found pages when checking the Referring URL. For example: Referring URL:
Link Explorer | | ProspectoGroup
https://ofertolino.ro/oferte/barn%C3%A4ngen 404:
https://ofertolino.ro/barn%C3%83%C2%A4ngen What happens is that the referring URL leads to a redirect (https://ofertolino.ro/barn%C3%A4ngen) but it never leads to the specified 404 Page (which has even a more weird symbol in the URL when it is url decoded) in the report. What could be the issue here and is the Moz bot responsible for such misbehaviour?0 -
Crawling 4XX errors because of URL accented
Hello guys, I am experiencing crawling errors in Moz because the URLs read by spiders contain accents and special characters, which I know isn't best but yet my client needs to keep it. I know that Moz "uses percent encoding to parse the HTML in the source code, so any line breaks and spaces in your HTML links or sitemap links are converted to %0A and %20, causing a 404 error". Is there any way to avoid these errors happening in the dashboard? Or am I supposed to simply ignore it?
Link Explorer | | fran8751 -
Moz's new Link Explorer displaying the DA marginally less than Site Explorer
Moz's new Link Explorer displaying the DA marginally less than Site Explorer. Old one is showing it 46 while new link explorer is showing the DA as 40.
Link Explorer | | dhananjay.kumar11 -
Can't make sense of OSE and MOZ.
I checked this site on my OSE and it shows only 7 inbound links a DA of 14 and no social activity whatsoever yet when I check it on Majestic it shows ExternalBacklinks 71 ReferringDomains 20 Referring IPs 19 Referring Subnets 19 . And.. the page is #1 on google search for hypnotherapy michigan. How can it rate so poorly on MOZ, show so much more on majestic and rank so high on google? I thought MOZ data was supposed to be among the best and that top rated pages on google should also rate high on MOZ. here is the site http://hypnotherapy-detroit.com Additionally, when i look at the site, i notice that most of the backlinks are exchanged links and this site's link exchange page isn't even linked from the home page. Now I thought that kind of link exchange game was now discounted by Google. I don't get it. No social pages at all... low page rank... no new content.. so by MOZ standards there is no justification for this page to be anywhere near page one let alone at position #1. Can someone help me make sense of all this?
Link Explorer | | HypnoPro0 -
Permanent 301 - Domain Authority
Hi, we created a new website which we also gave a new url.
Link Explorer | | DIGIHOUSE
We made a permanent 301 for the complete domain. www.digihouse.at -> www.digihouse-werbeagentur.at Google checked that and we rank minimum as good as with the old domain.
But in MOZ Tools the Domain Authority is very bad now.
So i think the 301 influences Google but not the Moz Tools?
The Domain Authority will not be inherited in Moz Tools? thxChris0 -
Inbound Links Sorted by Linking Domain
Hi All -- Does anyone know if it is possible to generate a report (or is there a setting) to have the OSE inbound links report sorted by OSE linking domain? Ideally, the report would create a second column in the "Inbound Links" report with "Linking Domain" and then you could create a nice report that cross-tabbed the links. While you could do some excel text manipulation to do this, does anyone know if it's possible to do through the report generator? Thanks, Matt
Link Explorer | | Resolution_Rentals0 -
301 Redirects: How long for Google to recognize? How long for Moz/OSE to recognize?
I redirected a few pages that had funky URL issues (capitals and underscores and useless words) to the same page renamed with proper URLs. The sitemaps were changed also, and re-submitted. Like this: mydomain.com/Not_Pertinent_Words.html >>> mydomain.com/good-words.html Google seems to have found them and changed the search engine results listing in about 8 days. But it's been about a month now and Moz and OSE still have not transferred all the strength and link data from the old URLs to the new ones. Question 1: How long does it usually take Google to transfer all the link and strength data for a 301? Question 2: How long does it take Moz and OSE to do the same? Is there something I need to do to tell them about the changes?
Link Explorer | | GregB1230