Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Question about robots file on mobile devices

Intermediate & Advanced SEO

476

Andy-Halliday last edited by

Hi

We have a robots.txt file, but do I need to create a separate file for the m.site or can I just add the line into my normal robots file.

Ive just read the Google Guidelines (what a great read it was) and couldn't find my answer.

Thanks in Advance

Andy
1 Reply Last reply
Reply Quote 0
Andy-Halliday last edited by

Hi Patrick

I thought that but just wanted to triple check before writing a nice list for my developers tomorrow.

Thanks

Andy
1 Reply Last reply
Reply Quote 0
PatrickDelehanty last edited by

Hi there

Yes, if you have a mobile site, you should create a separate robots.txt and sitemap, among other things.

I would also create a Google and Bing Webmaster Tools profiles for your mobile site so you can watch it with more granularity.

Hope this helps! Good luck!
1 Reply Last reply
Reply Quote 2

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Question about region codes and Hreflang?

A client (see example above) has accidentally place region codes into the hreflang when the content is intended for all audiences that speak the language. So "fr-fr" should really just be "fr" since those that are "fr-be", "fr-ca", and "fr-ch" should all be getting to the French version of the website too. And there isn't a specific subdirectory for French speakers in Belgium or France or Switzerland, etc. However, when looking at Google Analytics, these region codes don't seem to be stopping those from other regions from getting to the correct landing page. So a user from Belgium is still getting to https://www.example.com/fr/ depsite the "fr-fr" in the hreflang. So question: is it worth adjusting the hreflang to be non-region specific (from
Intermediate & Advanced SEO | | SearchStan

0
New Subdomain SEO questions

I have a main site - mysite.com. I just created a subdomain - leadform.mysite.com I plan to use the leadform.mysite.com as a 1 page lead form only. I will link to leadform.mysite.com from mysite.com and also from other websites I own (myothersite.com etc.) - filtering all traffic to this form to capture leads. (Note - the leadform.mysite.com has CNAME to other server that hosts the backend of the form) My questions are: How should I link from mysite.com to leadform.mysite.com? With dofollow or nofollow? (mysite.com has 1000's of pages and would link from every page with "get a quote' type button) 2) How should I link from myothersite.com to leadform.mysite.com? With dofollow or nofollow? Any SEO risk linking to leadform.mysite.com from an outside domain? (myothersite.com has 1000's of pages and would link from every page with "get a quote' type button) Does it make sense to build links from outside sites to leadform.mysite.com directly to try to get that lead capture page to rank on it's own? 4) Does it make sense to link back from leadform.mysite.com back to mysite.com for seo value? With dofollow or nofollow? Thanks in advance for any help.
Intermediate & Advanced SEO | | leadforms

0
Disavow files on m.site

Hi I have a site www.example.com and finally have got the developers to add Google webmaster verification codes for: example.com m.example.com As I was advised this is best practice - however I was wondering does this mean I now need to add the disavow file. Thanks Andy
Intermediate & Advanced SEO | | Andy-Halliday

0
Mobile homepage title is showing unrelated text

Hi all, I've read the FAQs and searched the help center. My URL is: http://www.leibish.com/I just discover it today - when searching on mobile for the brand name (search for "Leibish") I find the following title: Reply (see the attached image).Also, when searching for site:leibish.com +reply you'll find at least a few dozens indexed pages with this title.I checked for the following:1. Link bombing - check with ahrefs and majestic - everything seemed fine.2. Alt tag or other hidden text - couldn't find anything. 3. DMOZ or Yahoo directory submissions with this anchor text - yet, nothing.Besides the fact that I must fix this issue I find it fascinating from the SEO perspective. I need the big guns in here - can you help my resolve this mystery? :-)Thanks...
Intermediate & Advanced SEO | | seoperad

0
When Mobile and Desktop sites have the same page URLs, how should I handle the 'View Desktop Site' link on a mobile site to ensure a smooth crawl?

We're about to roll out a mobile site. The mobile and desktop URLs are the same. User Agent determines whether you see the desktop or mobile version of the site. At the bottom of the page is a 'View Desktop Site' link that will present the desktop version of the site to mobile user agents when clicked. I'm concerned that when the mobile crawler crawls our site it will crawl both our entire mobile site, then click 'View Desktop Site' and crawl our entire desktop site as well. Since mobile and desktop URLs are the same, the mobile crawler will end up crawling both mobile and desktop versions of each URL. Any tips on what we can do to make sure the mobile crawler either doesn't access the desktop site, or that we can let it know what is the mobile version of the page? We could simply not show the 'View Desktop Site' to the mobile crawler, but I'm interested to hear if others have encountered this issue and have any other recommended ways for handling it. Thanks!
Intermediate & Advanced SEO | | merch_zzounds

0
Huge increase in server errors and robots.txt

Hi Moz community! Wondering if someone can help? One of my clients (online fashion retailer) has been receiving huge increase in server errors (500's and 503's) over the last 6 weeks and it has got to the point where people cannot access the site because of server errors. The client has recently changed hosting companies to deal with this, and they have just told us they removed the DNS records once the name servers were changed, and they have now fixed this and are waiting for the name servers to propagate again. These errors also correlate with a huge decrease in pages blocked by robots.txt file, which makes me think someone has perhaps changed this and not told anyone... Anyone have any ideas here? It would be greatly appreciated! 🙂 I've been chasing this up with the dev agency and the hosting company for weeks, to no avail. Massive thanks in advance 🙂
Intermediate & Advanced SEO | | labelPR

0
Site changes lead to big questions

I'm making some changes to my business that will cause me to move my blog to a new domain. The existing site will serve as a sales campaign for our full service programs and I want to keep visitors focused on that campaign. The old site will serve much like a mini site with a sales letter and video sales letter. In moving the blog content to another page - I found a post from Rand from a few years ago http://www.seomoz.org/blog/expectations-and-best-practices-for-moving-to-or-launching-a-new-domain. The way I wanted to approach this was to remove the content from the old site, and then resubmit the site map to Google for indexing. Of course they'll notice that the blog pages are gone. (probably a load of 404's) After perhaps a week, I'd repost the content (about 50 posts) on the new domain, which will be little more than a blog. I'd like some input on the way to approach this. Should I... a) Follow Rand's formula? b) Go with my idea (sort of the brute force model)? c) Consider an alternative method? It's probably worth mentioning that none of these posts have high search engine rankings. I appreciate your input Mozzers!
Intermediate & Advanced SEO | | sdennison

0
Missing Title Tags on Include Files?

GWT is telling me 3 of my include files (Contact Form - Header - Footer) are missing a Title Tag. This has never happened to me before and don't know how to tackle it. On the other hand the warning refers to a subdirectory of my site to these respective include files… The main directory, with literally the same html structure and no Title, returns no errors. Any ideas as to why this error now? or how to fix it? Thanks,
Intermediate & Advanced SEO | | dhidalgo1

0