Location Based Content / Googlebot

[Allstar]

Our website has local content specialized to specific cities and states. The url structure of this content is as follows: www.root.com/seattle www.root.com/washington When a user comes to a page, we are auto-detecting their IP and sending them directly to the relevant location based page - much the way that Yelp does. Unfortunately, what appears to be occurring is that Google comes in to our site from one of its data centers such as San Jose and is being routed to the San Jose page. When a user does a search for relevant keywords, in the SERPS they are being sent to the location pages that it appears that bots are coming in from. If we turn off the auto geo, we think that Google might crawl our site better, but users would then be show less relevant content on landing. What's the win/win situation here? Also - we also appear to have some odd location/destination pages ranking high in the SERPS. In other words, locations that don't appear to be from one of Google's data center. No idea why this might be happening. Suggestions?

[MoosaHemani]

I believe the current progress is pretty much relevant to user but do provide the option to change the location if user want to manually change it! (it will be a good user experience)

To get all links crawled by search engine, here are few things that you should consider!

• Make sure sitemap have all links appearing that have on the website. Including all the links in the xml sitemap will help Google to consider those pages
• Point links to all location pages. This will help Google to consider indexing those pages and make it rank for relevant terms.
• Social Signals are important try to get social value of all location pages as Google usually crawl pages with good social value!

I think the current approach is awesome just add manually change location option if a visitor wants it.

[mrdavidingram]

Thanks Jarno

[JarnoNijzing]

David,

well explained. Excellent post +1

Jarno

[mrdavidingram]

Hi,

In regards to the geo-targeting, have a read of this case study. To me it's the definitive guide to the issue as it goes through most of the options available, and offers a pretty solid solution:

http://www.seomoz.org/ugc/territory-sensitive-international-seo-a-case-study

And if you are worrying about the white/black aspects of using these tactics, here is a great guide from Rand on acceptable cloaking techniques:

http://www.seomoz.org/blog/white-hat-cloaking-it-exists-its-permitted-its-useful

And finally a great 'Geo-targetting FAQ' piece from Tom Critchlow:

http://www.seomoz.org/blog/geolocation-international-seo-faq

In regards to the other locations ranking that you don't think have been crawled, this is probably down to the number/strength of the links pointing at this sections. Google have stated in various Webmaster videos that a page doesn't neccessarily need to be crawled to be indexed (weird huh?), Google just needs to know it exists.

If there were plenty of links point at a page, Google would still believe it's an authoritative/relevant result even if it hasn't crawled the page content itself. It can use other signals such as anchor text to determine the relevancy for a given search term.

Here is an example video from Matt Cutts where he discusses the issue:

http://www.youtube.com/watch?v=KBdEwpRQRD0

Best of luck

David