Why are these results being showed as blocked by robots.txt?
-
If you perform this search, you'll see all m. results are blocked by robots.txt: http://goo.gl/PRrlI, but when I reviewed the robots.txt file: http://goo.gl/Hly28, I didn't see anything specifying to block crawlers from these pages.
Any ideas why these are showing as blocked?
-
Hi,
Your robots.txt file is very .. steroid healthy. It has his own universe
Are you 100% sure all of the entries are legit and clean ?
First thing I would do is to check Web M;aster Tools for the mobile subdomain. If you don't have it yet, that will be a good place to start - to verify the m subdomain.
Once in WeB Master Tools - you can debug this in no time.
Cheers.
-
but, even when i search from my mobile device, I get the same results (that m. is blocked)
-
I can't submit because I haven't claimed m. in GWT
-
If you haven't already done so, I recommend testing your robots.txt file against one of your mobile pages (such as m.healthline.com/treatments) in Google Webmaster Tools. You can do this by logging into GWT, then click Health, then Blocked URLs.
If you have already tested it in GWT, can you let us know what the results said?
-
Another good article from the community
-
So after a little it or research as I never ever came past this before as all the site we do are responsive, I found this
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=72462
It seems Google wont index a website that they think is a mobile website within the main serp, and vice verse ...
Hope that helps, cause it had me puzzled
Regards
John
-
Which directory are you storing your mobile website files within ...
-
Oh, sorry, on further investigation I see its just your mobile site that are being blocked ...
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Paginated category pages still showing in Google
Despite our blog using rel=next and rel=”prev” we’re still finding paginated pages getting impressions in Google, suggesting they are taking up unnecessary crawl budget. An example is: https://www.theukdomain.uk/seo/page/2/ What steps would you recommend I take to most benefit my sites SEO? Thanks, Sam
Intermediate & Advanced SEO | | sjefferies0 -
Why i get bad results since 4 monthh ago
hi...i have website...and i was in first place in page1 since 4 month ago. but somehow i take 5th place . its weird because whin compare my moz results there really better in number and better da and pa and lower spam score. why they get better result in my main kewords???!!! this is my website saadatrent.com and this is main keyword "اجاره ماشین" + "اجاره خودرو"
Intermediate & Advanced SEO | | avaye0 -
Interested ranking results
Hello, I have different pages that are written on the same model. I updated their content 2 weeks ago. Some of those climbed to 1 st page or beginning or 2 nd some didn't move or stayed where they originally were, 3 rd of 4 th page ? My question is whether there is a longer delay for some of them to rank (due to the term being more competitive for example) or if I should look somewhere else in maybe something that I wrote in the content of the pages that ranked versus those than didn't move. Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Is there a way to show random blocks of text to users without it affecting SEO? Cloaking for good?
My client has a pretty creative idea for his web copy. In the body of his page there will be a big block of text that contains random industry related terms but within that he will bold and colorize certain words that create a coherent sentence. Something to the effect of "cut through the noise with a marketing team that gets results". Get it? So if you were to read the paragraph word-for-word it would make no sense at all. It's basically a bunch of random words. He's worried this will affect his SEO and appear to be keyword stuffing to Google. My question is: Is there a way to block certain text on a webpage from search engines but show them to users? I guess it would be the opposite of cloaking? But it's still cloaking...isn't it? In the end we'll probably just make the block of text an image instead but I was just wondering if anyone has any creative solutions. Thanks!
Intermediate & Advanced SEO | | TheOceanAgency0 -
Why is Google Displaying this image in the search results?
Hi i'm looking at advice on how to remove or change a particular image Google is displaying in the search results. I have attached a screenshot. From the first look of it, i assumed the image would be related and be on the dealers Google+ Local Page: https://plus.google.com/118099386834104087122/about?hl=en But there are no photos. The image seems to be coming from the website. Is there a way to stop Google from displaying this image or making them display a totally different image. Thanks, Chris XzfsnUy.png
Intermediate & Advanced SEO | | Mattcarter080 -
Panda Updates - robots.txt or noindex?
Hi, I have a site that I believe has been impacted by the recent Panda updates. Assuming that Google has crawled and indexed several thousand pages that are essentially the same and the site has now passed the threshold to be picked out by the Panda update, what is the best way to proceed? Is it enough to block the pages from being crawled in the future using robots.txt, or would I need to remove the pages from the index using the meta noindex tag? Of course if I block the URLs with robots.txt then Googlebot won't be able to access the page in order to see the noindex tag. Anyone have and previous experiences of doing something similar? Thanks very much.
Intermediate & Advanced SEO | | ianmcintosh0 -
Why have I disappeared from 1st page to outside top 100 results?
I have been #2 in Google for "plenty more fish" for about 8 years and have now disappeared. I've been told that I have no manual spam action against my domain www.plentymorefish.net. Can anyone suggest why I have disappeared and how I might rectify this? My guess is something to do with the Panda update Sept 27th - EMD (Exact Match Domain), although I don't understand why Google have left a competitors site #1 as this also has exact match domain. Maybe they've just picked one exact match domain to display and have not chosen mine as the .com has a better overall SEO score. Appreciate any assitance. Thanks.
Intermediate & Advanced SEO | | benners0 -
What should I get my assistant to do? (SEO wise, no real results!)
We own a video search site like casttv.com, now there is not much 'content' we can develop. I want to rank high for certain video names for Google. In terms of seo, i have told our assistant (seo guy now) to basically find all sites on the net related to videos and collect their about us and contact them, and see if we can build any sort of partnership and also to post a new interesting article a day for our blog... He has contacted 500 sites of which we were able to get good links from 5 of them (1 way). He has exhausted his search of quality 'video' sites, now what? what can I have him do so we can actually start ranking, we have 100k pages indexed of which we have around 1million. Only the top pages are allowed to be indexed, in terms of off page seo, what can I have our seo guy do all day now? should I fire him ($3k a month) and get a PR firm to try to get us into newspapers instead?
Intermediate & Advanced SEO | | ketlad0