Why are these m. results showing as blocked?
-
If you go to http://bit.ly/173gdWK, you'll see that m. results are showing as blocked by robots.txt, but we don't have anything in our robots.txt file that specifies to block m. results. Any ideas why these URLs show as blocked?
-
Yeah, I was testing exactly the same when you posted the response. I even tried crawling a googlebot-mobile and still I get the 301 redirect. Which, for everything that I am seeing it is correct, as no matter what browser I use (desktop, mobile, spider) I always get a 301 to the www. version.
@michelleh, are you sure there's a mobile version not being redirected to the www. one?
-
(Using example.com instead of your domain in case you want anonymity later)
If you try to go to any of these m.example.com URLs on your desktop computer, you're redirected on the server to a www.example.com URL. I'm guessing Googlebot and Googlebot-Mobile cannot access m. pages (unless you're sniffing out Googlebot-Mobile specifically to serve it m.example.com pages). If you're looking at screen resolution for these redirects, you might not be catching Googlebot-Mobile, as I don't think Googlebot-Mobile gives a screen resolution in its user agent. I believe you want Googlebot indexing your www. content, and Googlebot-Mobile indexing your m. content, so you'll need to sniff out Googlebot-Mobile's user agent (see here), and redirect it to m. content.
Also of note is that I think these should be 302 temporary redirects, and not 301 permanent redirects between your www. and m. versions, as they're not really permanent, just getting a given user to the right version of the site. Also, you don't let me switch from the mobile version to the desktop version, which drives me bananas! Let users choose after the initial redirect. If you allow people to switch, but maintain 301 redirects, the browsers may cache some of the redirects which will lead to weird behavior if people hit a page that redirected before.
You don't have a robots.txt file at m.example.com/robots.txt, as that redirects to www.example.com/robots.txt even on my phone. I don't think this is the root of the problem, but once you figure things out, you can set up a robots.txt file on your m. subdomain.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mystery URLs showing in Analytics - All 404s
Hi Guys So we have a whole load of mystery urls showing in analytics .The urls are completely not relevant and have somehow been created However - when you click on the URLs - they all go to 404 pages - pages not found. The website is a travel website but is showing pages like /overcome-fatigue-during-mesothelioma-treatment/ in analytics. Webmaster is not showing any of these pages - but analytics is showing traffic for them??? My initial thought was that it was a spam URL injection - but they are not pages. They don't exist Our database is fine, WP admin seems fine - none of these supposed pages have been created on WP - so why are they showing on analytics as having driven traffic??? None of the urls are indexed on Google. Its a mystery!!!! Can anyone help? Has anyone seen this before????
Intermediate & Advanced SEO | | CayenneRed890 -
Mobile Google SRP not showing Mobile breadcrumb
Hi,
Intermediate & Advanced SEO | | vivekrathore
I have implemented schema code for Breadcrumb on mobile site which is same as on Desktop. Now Desktop breadcrumb structure is getting visible on Google SRP, but when i check Mobile breadcrumb structure in Android Phone Google SRP, it is not visible. I have verified both code in schema structure tool. Is there any different schema code for mobile breadcrumb. Need any additional information regarding this, please send me your queries.0 -
How soon should new links show up?
Hi I know that GWT's will not show all my links but is there a 3rd party (other than Moz of course!) tool that will? And how quickly should they show up? Thanks Ash
Intermediate & Advanced SEO | | AshShep10 -
ECommerce search results to noindex?
Hi, To avoid duplicated content and the possibility of thousands additional pages to an ecommerce website would it be a reasonable solution to have the page as a no-index, would this benefit the site? Thanks **Lantec **
Intermediate & Advanced SEO | | Lantec0 -
Google webmaster tools showing "no data available" for links to site, why?
In my google webmaster account I'm seeing all the data in other categories except links to my site. When I click links to my site I get a "no data available" message. Does anyone know why this is happening? And if so, what to do to fix it? Thanks.
Intermediate & Advanced SEO | | Nicktaylor10 -
What can I do to put these pages back in the top results?
Hello here, here is an interesting question for you. The following 2 webpages from our website have been ranking well on Google (usually on the 1st or 2nd page) for the past 12 years. They are among our oldest, highly relevant product pages on our site: http://www.virtualsheetmusic.com/score/Moonlight.html http://www.virtualsheetmusic.com/score/Eliza.html And we could always find them with the keyword "moonlight sonata sheet music" or "fur elise sheet music". Now, since the last November these pages don't show up anymore despite they are still present in the index. It is pretty hard to understand why those pages don't show up in the search results for those keywords as they used to, above all if you consider that those are among our best, most popular and unique product pages! But instead to struggle to understand why we lost presence (Panda? Some unknown sort of penalization?), has anyone any suggestions to help us to have those pages back in the top results? What do you suggest to do in such kind of cases? Any ideas and thoughts are very welcome! Thank you in advance.
Intermediate & Advanced SEO | | fablau0 -
Why is google showing our blog like this?
Why is our blog title saying "the blog" before it in Google? X4vTU.png
Intermediate & Advanced SEO | | Tatango0 -
Google Maps results doesn't show my site url but rather the maps url, why is this?
For several of my clients landing pages that show up in the Maps results the website url has been overwritten by the maps url (maps.google.com). Even though on my places page I have the correct website set up. Does anyone have any idea why they would be doing this and how I can correct it? Thanks kinldy in advance, Aaron. maps-url.png
Intermediate & Advanced SEO | | afranklin0