SEOMOZ Crawler unicode bug
-
for the last couple of weeks the SEOMOZ crawls my homepage only and gets 4xx error for most of the URL's.
the crawler have no issues with English url's only with the unicode(Hebrew) ones.
this is what is see in the csv export for the crawl (one sample) :
http://www.funstuff.co.il/׳ž׳¡׳
׳‘׳×-׳¨׳•׳•׳§׳•׳× 404 text/html; charset=utf-8you can see that the URL is Gibberish
please help.
-
Hey Asaf,
Thanks for writing in.
We have a known issue where Hebrew isn't parsed right by our crawler so it has caused issues in the past. The issues have been intermittent but they can affect the data you see. Sorry about that. Our engineers have been working to get a fix out there for the Hebrew character set, so stay tuned.
Best,
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ Crawler
Hi, how much time it will take MOZ crawler to take entire site? In 24 hours it crawled only 500 pages isn't it too slow? My website has almost 50k pages.
Moz Pro | | macpalace0 -
About 30days free trial for SEOmoz Pro
Just a quick question. I am pretty sure that the rate limit of requesting for SEOmoz Pro is every 2 seconds.
Moz Pro | | flaminGoGo
Before become a Pro member, we can always sing up for 30days free trial and is that free trial has the same rate limit of requesting every 2 seconds?0 -
Even blackhat world wished me happy birthday... What up SEOmoz?
Blackhat World: "We at Black Hat Forum Black Hat SEO would like to wish you a happy birthday today!" SEOmoz: crickets Happy birthday indeed watch?v=JOBYJrVQm3A
Moz Pro | | JasonJackson0 -
SEOmoz vs Google Webmaster Tools on incoming links
I'm working on basic SEO for http://queueassoc.com. Google has indexed the non-www verions of the pages and these are what the SERPS return SEOmoz toolbar shows that all of the incoming links juice goes to the www. versions of the pages, none to the non-www version. Yesterday I set up GWMT for the site, submitted a sitemap with the www version of the pages and set the default address to the www version. I had to verify both versions of the site in order to do this and in looking at the non-www version I saw that Google had all the incoming links there and none in the www.version, the opposite of what SEOmoz shows. Is this just because Google only has the non-www versions in its index? Will they show the links to the www version once they get them in the index? I'm worried about losing Google Page Rank value or SEOmoz DA by making this switch.
Moz Pro | | bvalentine0 -
SEOmoz keyword rankings in campaign report
Hi. Does anybody know where the rankings summary has moved to in the campaign reports? I want to know how many keywords have moved up or down in the last week and can't find it anywhere!
Moz Pro | | neooptic1 -
SEOmoz Toolbar vs. Opensiteexplorer
Dumb question, why is the SEOmoz Toolbar reporting vastly different data than opensitexplorer? I had assumed they pulled from the same data set. False assumption? Am I misinterpreting the metrics? The discrepancies with which I am most confused are differences in number of root linking domains between OSE and Toolbar. Please enlighten me.
Moz Pro | | Gyi0 -
SEOMoz site crawlers created an issue for our servers
I have set up a number of campaigns with your pro tool. Unfortunately we have 7 sites on our server and our IT dept have said that we had an issue when your site crawlers visited for several sites at the same time - is there any way that I can retain the campaigns but have the sites crawled on request rather than automatically?
Moz Pro | | StephenALee0
