SEOMOZ Crawler unicode bug
-
for the last couple of weeks the SEOMOZ crawls my homepage only and gets 4xx error for most of the URL's.
the crawler have no issues with English url's only with the unicode(Hebrew) ones.
this is what is see in the csv export for the crawl (one sample) :
http://www.funstuff.co.il/׳ž׳¡׳
׳‘׳×-׳¨׳•׳•׳§׳•׳× 404 text/html; charset=utf-8you can see that the URL is Gibberish
please help.
-
Hey Asaf,
Thanks for writing in.
We have a known issue where Hebrew isn't parsed right by our crawler so it has caused issues in the past. The issues have been intermittent but they can affect the data you see. Sorry about that. Our engineers have been working to get a fix out there for the Hebrew character set, so stay tuned.
Best,
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Did Profiles on SEOmoz get de-indexed?
Hi fellow mozzers My profile page on SEOmoz has always ranked well for my full name "Jacob Eeckhout". Recently I noticed that it doesn't show anymore, even for the query site:seomoz.org "jacob eeckhout". Does anyone know what happened?
Moz Pro | | Jacobe0 -
Are the SEOMoz queries banned by Google?
Hi: In our company, we have notified that Google is banning our IP due to massive queries under the same IP. It is caused mainly by local softwares installed in PCs or some plugins of Firefox. We think that SEOmoz don´t causes this due to its tool uses its own IP and servers, not ours. We would like your opinion about this. Thank you,
Moz Pro | | Equipo_SEO_HUB_Interaction0 -
Does SEOmoz give a way to know what link on what page produces the 404 errors that SEOmoz is telling me I have??
SEOmoz gives me a report of 404 errors on my site. Do they give a way to know from what link on what page produces the error?
Moz Pro | | MeridianGroup0 -
How can you set SEOmoz to work with your dev site behind an htpasswd?
All sites need to be developed from the small to the grand - and this takes time. Development usually takes place on a subdomain different from our live domain. It is locked down behind an htpasswd during development so its not picked up by searching engines - that may create duplicate content issues if when the site goes live it has already scanned our site on the development server. Its also a security implementation to keep the site away from prying eyes before its ready for launch There could be security holes that have not been tweaked. Whats the best strategy to get SEOmoz involved in this scenario. Its tools are invaluable to the SEO part of the build - but the seomoz crawler bot has a different IP address (being cloud based) - so we cannot just let a single IP address through our htpasswd. Also is there a way to link the dev and live site in seomoz - so when it goes live to maintain all teh same logs without having to create two seperate site campaigns? Thanks!
Moz Pro | | dseo2410 -
How do I add a second email to SEOmoz?
Is there a way to add a second email adress to my SEOmoz account, so that 2 people can get notifications from here?
Moz Pro | | wellbo0 -
301 redirect in SEOMoz campaigns tool
I did a 301 redirect to another domain and I would like to change the domain name in SeoMoz campaigns tool to continue to track the keywords, is it possible ?
Moz Pro | | mhenriques0 -
What's your favorite part of SEOMoz PRO?
Hi, I'm just getting familiar with all of the cool tools on SEOMoz PRO. There's a lot to use on the pro members area of the site! What are the best tools,etc.? Or is it more about just joining the community and participating? What is your favorite part of SEOMoz PRO? Thanks! -Erica
Moz Pro | | ownlocal2
