Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Question about robots file on mobile devices

Intermediate & Advanced SEO

476

Andy-Halliday last edited by

Hi

We have a robots.txt file, but do I need to create a separate file for the m.site or can I just add the line into my normal robots file.

Ive just read the Google Guidelines (what a great read it was) and couldn't find my answer.

Thanks in Advance

Andy
1 Reply Last reply
Reply Quote 0
Andy-Halliday last edited by

Hi Patrick

I thought that but just wanted to triple check before writing a nice list for my developers tomorrow.

Thanks

Andy
1 Reply Last reply
Reply Quote 0
PatrickDelehanty last edited by

Hi there

Yes, if you have a mobile site, you should create a separate robots.txt and sitemap, among other things.

I would also create a Google and Bing Webmaster Tools profiles for your mobile site so you can watch it with more granularity.

Hope this helps! Good luck!
1 Reply Last reply
Reply Quote 2

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Question about Topics and subjects of sentences

Hello, This might be a bit of technical question but how is google linking entities together ? I understand that when writing a piece of content I need to cover multiple topics (which are also entities as far as I understand). Then, in order for google to link multiple entities together my guess is that my sentence needs to be written in subject, predicate, object format ? where my topic / entity comes out as the subject of the sentence. For example if I write that: "Tuscany is a famous for it's rolling hills?, here the subject is Tuscany which is what I want as it one of the topics I want to cover. But let's say that instead I write:" Rolling hills is something you find everywhere in Tuscany". Here Tuscany doesn't help because it isn't a subject and is just dropped there, correct ? Concerning the attributs of my entities (the object), does google have a list of what is right of wrong. For example if I say that Washington is the capital of italy ? can I be penalised for that ? I guess this is called entity disambiguation ? If the capital of italy would also be called Washington I believe that I would be ok but see that it isn't, can it hurt ? Thank you,
Intermediate & Advanced SEO | | seoanalytics

0
Desktop vs. Mobile Website - ranking impact

Working on develop mobile pages using dynamic serving method, we are planing on only develop number of important pages (not the whole site) to be mobile friendly. To keep the consistency of the user experience, the new mobile site will only have internal links to pages that are mobile friend. Questions: If an existing non-mobile page ranking #1 on mobile SERP today, this page will not have a mobile friendly version, and will not link in the mobilefriendly site. will there be any impact to the ranking. Assuming: When Google mobile/Smartphone bots will not see a link to this page. The page will still accessible to Google desktop bots.
Intermediate & Advanced SEO | | tomchu

0
Robots.txt gone wild

Hi guys, a site we manage, http://hhhhappy.com received an alert through web master tools yesterday that it can't be crawled. No changes were made to the site. Don't know a huge amount about the robots.txt configuration expect that using Yoast by default it sets it not to crawl wp admin folder and nothing else. I checked this against all other sites and the settings are the same. And yet 12 hours later after the issue Happy is still not being crawled and meta data is not showing in search results. Any ideas what may have triggered this?
Intermediate & Advanced SEO | | wearehappymedia

0
301 or Canonical - Ecommerce Site Question

We are making a change to our Navigation and this includes having to change the URL structure of a few pages of our site. Due to issues with the CMS (that are out of my control) we are unable to keep the current URL structure of two of our highest ranking pages. Our site is an E-commerce Site The Structure is changing from..... www.domain.com/page/highrankingpage <----OLD PAGE RANKED WELL to www.domain.com/category/highrankingpage <----NEW PAGE Generally I would have 301 'd this page but I found out that our Tech team added a Canonical to this page instead....(showing the high ranking page to the Search Engines) and on our site the visitors are able to browse the website getting the new page. BOTH PAGES ARE BASICALLY IDENTICAL (Same Content) http://searchenginewatch.com/sew/how-to/2288690/how-and-when-to-use-301-redirects-vs-canonical# Thoughts?
Intermediate & Advanced SEO | | CMcMullen

0
Do allow or disavow, that is the question!

We're in the middle of a disavow process and we're having some difficulty deciding whether or not to disavow links from Justia.com and prweb.com - justia.com alone is giving us 23,000 links with just 76 linked pages. So, to allow, or disavow? That's the question! What do you think guys? Thank you. John.
Intermediate & Advanced SEO | | Muhammad-Isap

0
Should comments and feeds be disallowed in robots.txt?

Hi My robots file is currently set up as listed below. From an SEO point of view is it good to disallow feeds, rss and comments? I feel allowing comments would be a good thing because it's new content that may rank in the search engines as the comments left on my blog often refer to questions or companies folks are searching for more information on. And the comments are added regularly. What's your take? I'm also concerned about the /page being blocked. Not sure how that benefits my blog from an SEO point of view as well. Look forward to your feedback. Thanks. Eddy User-agent: Googlebot Crawl-delay: 10 Allow: /* User-agent: * Crawl-delay: 10 Disallow: /wp- Disallow: /feed/ Disallow: /trackback/ Disallow: /rss/ Disallow: /comments/feed/ Disallow: /page/ Disallow: /date/ Disallow: /comments/ # Allow Everything Allow: /*
Intermediate & Advanced SEO | | workathomecareers

0
Checking Mobile Site Response Time

What is the best way to check the response time of a mobile site? Can this be done in Google Analytics/Webmasters?
Intermediate & Advanced SEO | | theLotter

0
What content should I block in wodpress with robots.txt?

I need to know if anyone has tips on creating a good robots.txt. I have read a lot of info, but I am just not clear on what I should allow and not allow on wordpress. For example there are pages and posts, then attachments, wp-admin, wp-content and so on. Does anyone have a good robots.txt guideline?
Intermediate & Advanced SEO | | ENSO

0