Baidu Spider hits my UK site every 5 minutes of every day for the past 2 years.
It has no consideration whether a domain exists or not.
I know this because looking at etc/httpd/logs/error_log, i am getting every 5 minutes hits from Baidu spider trying to access a domain which points to my server which no longer exists.
Given that I have absolutely no trade with China, and given that the only spam comments I get on my wordpress blog originate from China, do you think it's a good idea to either do a China country block in my .HTACCESS or block out Baidu spider?
Baidu is consuming bandwidth and is clogging my error_logs!!!
Why is it that Google, Bing, Yahoo etc... can all crawl my site nicely, but Baidu just abuses?