Where are the 301s taking Googlebot on those IP addresses? And are they the same IP addresses every time? Have you narrowed those IP addresses down to any particular datacenter/country? It could be possible there is some configuration with your server that treats IP addresses differently depending on the country... it could also be that the IP addresses getting the 301s are known blacklisted spam IP addresses but are masking themselves as Googlebot so your server's blacklist software is keeping them out. It's really hard to say without looking into the data myself but I'm definitely interested in what you find out.
Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Posts made by StreamlineMetrics
-
RE: Why would our server return a 301 status code when Googlebot visits from one IP, but a 200 from a different IP?
-
RE: Guys & Gals anyone know if urllist.txt is still used?
I would just use a sitemap.xml file instead for Google, Bing and Yahoo. Then you can submit the sitemap.xml file within the Google Webmaster Tools and Bing Webmaster Tools (includes Yahoo). You can easily create an XML sitemap at http://www.xml-sitemaps.com/
-
RE: My website is coming up under a proxy server "HideMyAss.com." How do I stop this from happening?
Great call on both the canonical tags and breaking out of the frame. I imagine the site will be indexed properly within a week using these tactics.
-
RE: My website is coming up under a proxy server "HideMyAss.com." How do I stop this from happening?
Interesting, I am now seeing what you are talking about...
-
RE: My website is coming up under a proxy server "HideMyAss.com." How do I stop this from happening?
Can you share your URL so we can take a look? Feel free to PM me if you want to keep it private.