Mobile site ranking in desktop searches
-
A robots.txt file is properly implemented on the mobile site to block Googlebot from crawling, yet, when running a site: query for the site in google, it still returns over 104,000 pages from the mobile site in the index.
Why could this be happening?
-
I have thse recomendations:
1. Specify your Doctype to help Google see what your content type is. For mobile Google supports XHTML Basic, XHTML Mobile Profile, XHTML, WML, cHTML (iMode), and EZweb (KDDI). We run HTML 5, CSS 3 and jQuery successfully but these are not specified by google, so i would recommend to be safe and go with what Google supports.
2. Add a specialized XML Sitemap for Mobile. It is basically the same as the usual Sitemap apart from adding these to elements: xmlns:mobile="http://www.google.com/schemas/sitemap-mobile/1.0 and mobile:mobileRead more here: http://www.google.com/support/webmasters/bin/answer.py?answer=34648</mobile:mobile>
P.S. Name it mobilesitemap.xml.
3. Use WURFL to redirect PC users finding mobi content in the www index back to the PC version.
That should help.
-
If you haven't asked a question in private Q&A yet this month, you can ask there and share your URL, as that is private and available to only SEOmoz staff and associates.
Have you gone into GWT and requested removal of the site? If you verify the site, and then have the site/directory blocked via robots.txt, you can use the removal tool to request removal rather than waiting for things to drop out of the index.
-
Thanks for responding Keri!
I can confirm that there are no parameters overriding the robots.txt within the code. I also can confirm that there is nothing amiss with the verification of the robots.txt.
Also, unfortunately, due to the nature of the client, we are unable to put the URL out there.
If you have any other thoughts, please do share. Sorry I couldn't be of more help.
Thank you.
-
How long has the robots.txt file been in place? If you added it just a few days ago, it takes time for things to get out of the index. Other thoughts are looking at the source code of the pages on the mobile site -- is there a robots parameter on the page that is overriding robots.txt?
Have you gone into GWT and used the robots verification tool there to make sure nothing was amiss?
If you can give us your URL, the community can take a look and see if they can figure anything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hi Mozers, is the AMP project is supposed to be an SEO factor on mobile platforms? Also, can it be used on ecommerce sites such as Magento or Shopify as well? Thanks!
It stands to reason that Google will favor early adopters of Accelerated Mobile Pages, but it seems heavily geared toward news publishers so far. What about regular Wordpress sites, or ecommerce sites like Shopify, should AMP be pursued on that type of CMS?
Technical SEO | | CalamityJane771 -
Why is my site not being indexed?
Hi, I have performed a site:www.menshealthanswers.co.uk search on Google and none of the pages are being indexed. I do not have a "noindex" value on my robot tag This is what is in place: Any ideas? Jason
Technical SEO | | Jason_Marsh1230 -
Domains redirect influence search rankings
Hi seomoz, I'm currently optimizing a website which is www.photobookworldwide.com and the ranking is on 2nd page, but looking at the result this morning, instead of showing photobookworldwide.com, it show other result which is www.photobooklaos.com on 2nd page for the keyword photobooks. Our web developer using virtual domain, and redirected photobooklaos.com to photobookworldwide.com. Any solution for this? need you guys to help me on this. Cheers Gerald
Technical SEO | | greathokage0 -
What caused my huge drop in search ranking?
On February 8th, 2012 my site's non-branded search traffic dropped overnight by over 80%. It appears I've been hit by a Google penalty. I submitted a reconsideration request and one of Google's staff replied letting me know it was NOT a manual penalty. So it's clearly a result of an algorithm. What is the cause? I haven't made significant changes to the website in the previous months do to being out of the country and the holidays. I'm extremely careful not to out source SEO so there is no chance of questionable link building strategies, unless my competitor launched an attack on my site. I've considered these possible causes: Duplicate content - My site had some redundancy from a marketing plan before Google Panda launched. Last month, I removed all duplicate content. Unnatural link building - I've been moving slowly my site, page by page, from adbio.com to bioworldusa.com after a brand change. Perhaps the 301 redirects triggered a flag in Google's algorithm. I've since removed all redirects to see if that will fix the issue. Poor User Experience - I recently upgraded my Drupal CMS and had to change themes. Currently my theme is an ugly, grey theme which may cause a higher than usual bounce rate. I've been trying to compensate by making sure the content is high quality. The penalty affected these website: www.bioworldusa.com (2/8/12) blog.bioworldusa.com (2/8/12) www.adbio.com (2/17/12)
Technical SEO | | bioworld1 -
Mobile site: robots.txt best practices
If there are canonical tags pointing to the web version of each mobile page, what should a robots.txt file for a mobile site have?
Technical SEO | | bonnierSEO0 -
Site revision
our site has complete redesign including site architecture, page url and page content (except domain). It looks like a new site. The old site has been indexed about thirty thousand results by google. now what should i do first?
Technical SEO | | jallenyang0 -
Impact of 401s on Site Rankings
Will having 401s on a site negatively impact rankings? (e.g. 401s thrown from a social media sharing icon)
Technical SEO | | Christy-Correll0