Mobile site ranking in desktop searches
-
A robots.txt file is properly implemented on the mobile site to block Googlebot from crawling, yet, when running a site: query for the site in google, it still returns over 104,000 pages from the mobile site in the index.
Why could this be happening?
-
I have thse recomendations:
1. Specify your Doctype to help Google see what your content type is. For mobile Google supports XHTML Basic, XHTML Mobile Profile, XHTML, WML, cHTML (iMode), and EZweb (KDDI). We run HTML 5, CSS 3 and jQuery successfully but these are not specified by google, so i would recommend to be safe and go with what Google supports.
2. Add a specialized XML Sitemap for Mobile. It is basically the same as the usual Sitemap apart from adding these to elements: xmlns:mobile="http://www.google.com/schemas/sitemap-mobile/1.0 and mobile:mobileRead more here: http://www.google.com/support/webmasters/bin/answer.py?answer=34648</mobile:mobile>
P.S. Name it mobilesitemap.xml.
3. Use WURFL to redirect PC users finding mobi content in the www index back to the PC version.
That should help.
-
If you haven't asked a question in private Q&A yet this month, you can ask there and share your URL, as that is private and available to only SEOmoz staff and associates.
Have you gone into GWT and requested removal of the site? If you verify the site, and then have the site/directory blocked via robots.txt, you can use the removal tool to request removal rather than waiting for things to drop out of the index.
-
Thanks for responding Keri!
I can confirm that there are no parameters overriding the robots.txt within the code. I also can confirm that there is nothing amiss with the verification of the robots.txt.
Also, unfortunately, due to the nature of the client, we are unable to put the URL out there.
If you have any other thoughts, please do share. Sorry I couldn't be of more help.
Thank you.
-
How long has the robots.txt file been in place? If you added it just a few days ago, it takes time for things to get out of the index. Other thoughts are looking at the source code of the pages on the mobile site -- is there a robots parameter on the page that is overriding robots.txt?
Have you gone into GWT and used the robots verification tool there to make sure nothing was amiss?
If you can give us your URL, the community can take a look and see if they can figure anything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ranking fluctuation
According to Miles Rank tracking I have a keyword that is fluctuating by 5 or 6 positions in a 24-hour period every time it goes 10 down to 15 and back to 10 again with very little stopping point in between and keeps fluctuating like that. As far as I know the website is stable it uses Magento 1.9 and is a fixed category page. The page URL is relatively new as we migrated from an old site with a different URL structure I added 301s at server level from the old page URL to the new one. There is only two things I can think that can be the problem -
Technical SEO | | seoman10
1. Lack of links directly to the page (there is literally only one or two)
2. Loading speed problem But I don't see any of these would cause a 5 position fluctuation regularly every day. But do you have any thoughts? Thanks in advance.0 -
Ranking
Hi, I am New Here in community.. My site Ranking Well in google But From Last two month its rank and traffic got down, i am worried about my site. and now when i created a new account on moz and check my site I saw there is a Spam Score: 5 /17 For my domain www.getmp3songspk.com I have Total indexed 1,132,913 url in google indexed Give Me Suggestion How can i remove bad links on my site. Seeking Help.
Technical SEO | | Getmp3songspk0 -
Site Blacklisted
Good morning. Just done my WMT ritual morning check and one of my sites has been blacklisted for malware. It's a wordpress site - I've run various scans, e.g. http://sitecheck.sucuri.net/scanner/ and also installed wordfence and scanned with that and wordfence produced some offending files which I have now deleted. I've also installed website defender in the hope that it wont happen again. I'm pretty good with staying on top of updates and rarely let a few days pass without upgrading new version of wordpress or plugins etc. I've also checked my users to make sure no new admins or anything and also changes passwords. I've asked for a review from Google and just wondered how long these reviews take? Also, has anybody got any advice, is there anything else I should be doing? Thanks
Technical SEO | | littlesthobo0 -
Ranking Multi-Language Site
Recently we updated our website to a new version. Our website has a structure in which the English page is our main page with about 50 subpages. All these pages are translated in 5 different languages. The different languages are divided into folders. For example www.ourdomain.com/de containts all german pages. The pages with products would be for example: www.ourdomain.com/products for english and www.ourdomain.com/de/produkte for the german page. On our previous website this used to be simililar. After the website update the SEOMoz crawls are showning duplicated page content/title errors for the pages saying that the pages in other languages have the same content/title as the basis English webpage. Any idea how I can solve these errors?
Technical SEO | | Exp0 -
Should I show archives on site?
Should I show my archives on my site? I have WordPress and have dragged the archive widget to the bottom. Would this be considered duplicate content?This is what it looks like. October 2012 September 2012 August 2012 July 2012 June 2012 May 2012 April 2012 February 2012
Technical SEO | | MyAllenMedia0 -
New Site Search Critique
Hi I am a huge fan of the SEOMOZ site and this great community which has helped me learn the current SEO skills I have now which are still very basic compared to the pros on the forum. I have tried to follow best practice regarding onsite and technical seo when developing my new site www.cheapfindergames.com and I would really appreciate it if experts on the forum could spare a minute to critique the site from a search perspective please This will give any elements of what onsite and technical SEO I done well and what aspects still need work. I am currently trying to build quality links and social mentions into the site which will take time, and the site has been designed around usability and conversions. Many Thanks Ian
Technical SEO | | ocelot0 -
PR Ranks
Do they really have a lot of value on how a site performs on Google? What is the best way to raise your PR Rank?
Technical SEO | | CalgaryRealtor390 -
Partial mobile sitemap
Hi, We have a main www website with a standard sitemap. We also have a m. site for mobile content (but m. is only for our top pages and doesn't include the entire site). If a mobile client accesses one of our www pages we redirect to the m. page. If we don't have a m. version we keep them on the www site. Currently we block robots from the mobile site. Since our m. site only contains the top pages, I'm trying to determine the boost we might get from creating a mobile sitemap. I don't want to create the "partial" mobile sitemap and somehow have it hurt our traffic. Here is my plan update m. pages to point rel canonical to appropriate www page (makes sure we don't dilute SEO across m. and www.) create mobile sitemap and allow all robots to access site. Our www pages already rank fairly highly so just want to verify if there are any concerns since m. is not a complete version of www?
Technical SEO | | NicB10