SEOMOZ Crawler unicode bug
-
for the last couple of weeks the SEOMOZ crawls my homepage only and gets 4xx error for most of the URL's.
the crawler have no issues with English url's only with the unicode(Hebrew) ones.
this is what is see in the csv export for the crawl (one sample) :
http://www.funstuff.co.il/׳ž׳¡׳
׳‘׳×-׳¨׳•׳•׳§׳•׳× 404 text/html; charset=utf-8you can see that the URL is Gibberish
please help.
-
Hey Asaf,
Thanks for writing in.
We have a known issue where Hebrew isn't parsed right by our crawler so it has caused issues in the past. The issues have been intermittent but they can affect the data you see. Sorry about that. Our engineers have been working to get a fix out there for the Hebrew character set, so stay tuned.
Best,
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does SEOmoz tool provide me the option to track rankings for other search engines like google.co.uk?
I need to track rankings on search engines across different geographies. Does your tool provide the option to track rankings for search engines other than the ones used in US
Moz Pro | | zycus0 -
SEOMoz Private Message Settings
Hi all, Is there a way to be notified (to my personal email address) when I get sent a private message? Thanks,
Moz Pro | | Unity
Davinia0 -
SEOmoz tools: Keyword Difficuty + On-page Analysis
To analyse the current KWD situation. I would want to see the top 10 results link metrics (as in Keyword Difficulty & SERP Analysis) and each page's On page score (as in On-page Analysis) for the keyword. Those two figures would give me a pretty good picture of the current situation. Kind regards,
Moz Pro | | OscarSE0 -
Why is it that certain keywords in my seomoz report card are for the wrong urls
Hi Guys, why is it that seomoz's On Page Optimization Reports for Google TH are attributing certain keywords with certain urls which are wrong? What mean is an example keyword - 'chiang mai villas for rent' has been scored an F against my home page url rather than using our 'Chiang Mai' url, why is this, is there a coding issue on my site? Is it that seomoz is finding something on my home page to suggest I want it to rank for this keyword?
Moz Pro | | ewanTHH0 -
How reliable is SEOMOZ data?
I have been using the Mozbar data to locate Auth websites, basically the higher the DA/PA the better it is. If I then check the site out and they have good load times, lots of social sharing etc this makes it extra special and now a good site to try and get a link on. I found 3 blogs to guest post on which all have DA/PA 80+ some of the blogs have a PR7. Now this is great but what scares me is have I just wasted 3 guest posts because the data is incorrect. These blogs are run by 1 person and the kind of work involved to achieve those stats would be very heavy. Maybe this blogger has just hit the nail on the head with SEO and link building. Input anyone?
Moz Pro | | activitysuper0 -
Seomoz logging in
Hey, The seomoz toolbar was permenantly logged in. But for some reason after a period of inactivity it now logs out and I have to relogin. I'm using firefox, what could be causing this?
Moz Pro | | PeterM220 -
Why does SEOMoz crawler ignore robots.txt?
The SEOMoz crawler ignores robots.txt It also "indexes" pages marked as noindex. That means it is filling up the reports with things that don't matter. Is there any way to stop it doing that?
Moz Pro | | loopyal0 -
SEOmoz Pro dashboard report question
Hi there, SEOMoz dashbard report shows 'URLs Receiving Entrances Via Search' - Is it counting only organic searches or all searches including PPC? Thanks, Gemma
Moz Pro | | RBA0
