Welcome to the Q&A Forum

Hi Wayne, Just to clarify you are having issues with a crawl error in Webmaster tools, and when you click the url it works fine? You can use tools such as Google Webmaster tools > Fetch as Google bot and input the url to see how Google Bot see's it in HTML. You can also download a text based browser such as Lynx to view your website very similar to how Google bot see's it. It will be very hard to determine a Crawl Path, as if that information was available we could develop trends and get a little closer to their algorithm. Crawler trackers can, on occasion cause hinderence to the crawler.Hope this helps.

Hi Sebes, I don't think this will be too much of a problem. Google will crack down hard on cloaking that will actually benefit your website, although sometimes you can do it by accident. This is adding no value to your website and I wouldnt worry about it too much. Always try to make your website the same for crawler + visitors it goes without saying.

I don't have the exact figures, I know Facebook has more visitors per month than Google, 90% of people searching use google, If i remember Google's US count is lower than 50%.

Some other quick stats:

Facebook has 60 million status updates a day, If Facebook was a country it would be the 3rd largest in the world. Youtube has over 100 hours of video uploaded a minute, Wikipedia has 1781 articles a hour added.