Mobile site ranking in desktop searches
-
A robots.txt file is properly implemented on the mobile site to block Googlebot from crawling, yet, when running a site: query for the site in google, it still returns over 104,000 pages from the mobile site in the index.
Why could this be happening?
-
I have thse recomendations:
1. Specify your Doctype to help Google see what your content type is. For mobile Google supports XHTML Basic, XHTML Mobile Profile, XHTML, WML, cHTML (iMode), and EZweb (KDDI). We run HTML 5, CSS 3 and jQuery successfully but these are not specified by google, so i would recommend to be safe and go with what Google supports.
2. Add a specialized XML Sitemap for Mobile. It is basically the same as the usual Sitemap apart from adding these to elements: xmlns:mobile="http://www.google.com/schemas/sitemap-mobile/1.0 and mobile:mobileRead more here: http://www.google.com/support/webmasters/bin/answer.py?answer=34648</mobile:mobile>
P.S. Name it mobilesitemap.xml.
3. Use WURFL to redirect PC users finding mobi content in the www index back to the PC version.
That should help.
-
If you haven't asked a question in private Q&A yet this month, you can ask there and share your URL, as that is private and available to only SEOmoz staff and associates.
Have you gone into GWT and requested removal of the site? If you verify the site, and then have the site/directory blocked via robots.txt, you can use the removal tool to request removal rather than waiting for things to drop out of the index.
-
Thanks for responding Keri!
I can confirm that there are no parameters overriding the robots.txt within the code. I also can confirm that there is nothing amiss with the verification of the robots.txt.
Also, unfortunately, due to the nature of the client, we are unable to put the URL out there.
If you have any other thoughts, please do share. Sorry I couldn't be of more help.
Thank you.
-
How long has the robots.txt file been in place? If you added it just a few days ago, it takes time for things to get out of the index. Other thoughts are looking at the source code of the pages on the mobile site -- is there a robots parameter on the page that is overriding robots.txt?
Have you gone into GWT and used the robots verification tool there to make sure nothing was amiss?
If you can give us your URL, the community can take a look and see if they can figure anything out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mobile SEO for mobile site
Hey there! I own a desktop website and just now finishe building a mobile site ( not a responsive design one) and I wish to start ranking my site on mobile serch result page. due to the automatic redirection from desktop website to the mobile site im confused: where should link to in order to SEO my mobile site? should i link to domin.com and assume the link juice is passing on? or should i link to m.domim.com?
Technical SEO | | logophone0 -
Google penalising my site? Ranking now outside top 50
Hey there, Was wondering if anyone could give me some advice/help on my current problems with my Google ranking. I used to be on page one this time last year (still am on yahoo and bing) but Google has pushed me out of the top 50. Since then I built a new site on wordpress with new content but it hasn't made any real difference. This is my site address: www.elvisimpersonator4u.co.uk I also have a separate blog here: www.thisiselvis.tv The blog did have some duplicate writing on it which I removed a few months back but it still hasn't improved my Google ranking. Would a 301 redirect fix this problem properly? I've done quite a lot of SEO on several pages on the new site to try and improve it but no luck so far. In fact I hope I haven't over optimised! No tools seem to indicate this though. I have no messages in webmaster tools so there's no obvious penalty, my web hosts keep saying I just need to buy more link builds and content writing from them but I've already done a lot of this and it's made no discernible difference. If someone could have a look and give me some advice I would be most grateful! Thanks,
Technical SEO | | devrox
Jim0 -
Mobile Site Domain/URL Structure
We are currently building a mobile optimised version of our main website and I had some questions with regard to SEO. 1. Is it best to structure the domain as: m.yourdomain.com yourdomain/m 2. It is correct to place rel="cannonical" on the mobile pages and to have only the main site indexed? Thanks in advance and links or books on mobile seo you can direct me to that would be greatly appreciated. Phil
Technical SEO | | Phily0 -
How much damage in search rank will my site suffer during an upcoming cms migration?
Hello, This is my first time on the seomoz forums and I hope I can get a real answer from this community of experts. I am migrating an existing site from an older cms (modx) to a newer cms (expression engine). The domain name isn't changing and neither will the keywords and keyphrases for existing pages. What is changing, however is the url suffix. This means I am going from www.domain.com/page-name.html to www.domain.com/page-name I can't seem to replicate the html sufffix in the new urls. Now this is the only reason why I will be setting up 301 permanent redirects from the old urls to the new ones. My question is: Will the domain suffer a loss in page rank or a substantial decline in search engine position as a result of this migration process? How fatal will it be? When can I expect my rankings to recover?
Technical SEO | | amit20760 -
Site Crawl
I was wondering if there was a way to use SEOmoz's tool to quickly and easily find all the URLs on you site and not just the ones with errors. The site that I am working on does not have a site map. What I am trying to do is find all the URLs along with their titles and description tags. Thank you very much for your help
Technical SEO | | pakevin0 -
What caused my huge drop in search ranking?
On February 8th, 2012 my site's non-branded search traffic dropped overnight by over 80%. It appears I've been hit by a Google penalty. I submitted a reconsideration request and one of Google's staff replied letting me know it was NOT a manual penalty. So it's clearly a result of an algorithm. What is the cause? I haven't made significant changes to the website in the previous months do to being out of the country and the holidays. I'm extremely careful not to out source SEO so there is no chance of questionable link building strategies, unless my competitor launched an attack on my site. I've considered these possible causes: Duplicate content - My site had some redundancy from a marketing plan before Google Panda launched. Last month, I removed all duplicate content. Unnatural link building - I've been moving slowly my site, page by page, from adbio.com to bioworldusa.com after a brand change. Perhaps the 301 redirects triggered a flag in Google's algorithm. I've since removed all redirects to see if that will fix the issue. Poor User Experience - I recently upgraded my Drupal CMS and had to change themes. Currently my theme is an ugly, grey theme which may cause a higher than usual bounce rate. I've been trying to compensate by making sure the content is high quality. The penalty affected these website: www.bioworldusa.com (2/8/12) blog.bioworldusa.com (2/8/12) www.adbio.com (2/17/12)
Technical SEO | | bioworld1 -
Bing rank drop off for multiple sites
Hi Mozzers, Seeing some wacky stuff going on on some sites I manage. In more than a few, the ranking on bing has dropped basically overnight from page one spots to not being found on the first 100 positions. Anyone else seeing similar results? Some of the sites are fairly new, some have been around for ages, some are wordpress, some are not. I've been searching for some news of a big change on bing, but keep reading about bing dropping the thin sites during black friday. In one example, I had the site set up in BWT for a while, and had a look at the data. The reports show that the pages are crawled, the index summary shows pages indexed, and there seems to be no crawl errors, but rankings are absolutely gone. Also, I can't see the sites in bing if I search "site:example.com" in bing. Here's 2 examples, the first would make sense since it's pretty thin as I havent added much content yet: http://homewindowtint.org but this one doesn't make sense to me. Sure there's a few errors, but to be dropped like a rock seems weird http://www.ahmedandsukaram.com
Technical SEO | | rosstaylor0 -
Non primary domain ranking higher in searches
Hey Guys, Hopefully I can explain this so that you can understand, let me know if you need me to clarify any particular points. I have a primary domain for my website, however someone has also pointed their domain at my server that has nothing to do with us or our website. Typing a keyword in a search engine will list our website as this has been crawled but it's listing the domain as their domain and not our primary. Is this because their domain has greater value then our primary? What's the best course of action to resolve the issue? The reason I ask is because the domain could potentially have a negative effect on business. If I setup hosting for this second domain and setup a redirect on it, all the traffic that is trying to reach us via respective search terms are then directed away from our site. I have been in contact with the domain administrator but they are yet to reply to my correspondence. Has anyone experienced something similar and come up with a good way to resolve it? Thanks guys, any help would be greatly appreciated.
Technical SEO | | digitalclubb0