Question about robots file on mobile devices
-
Hi
We have a robots.txt file, but do I need to create a separate file for the m.site or can I just add the line into my normal robots file.
Ive just read the Google Guidelines (what a great read it was) and couldn't find my answer.
Thanks in Advance
Andy
-
Hi Patrick
I thought that but just wanted to triple check before writing a nice list for my developers tomorrow.
Thanks
Andy
-
Hi there
Yes, if you have a mobile site, you should create a separate robots.txt and sitemap, among other things.
I would also create a Google and Bing Webmaster Tools profiles for your mobile site so you can watch it with more granularity.
Hope this helps! Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Questions about Event Calendar Format and Duplicate Content
Hi there: We maintain a calendar of digital events and conferences on our website here: https://splatworld.tv/events/ . We're trying to add as many events as we can and I'm wondering about the descriptions of each. We're pulling them from the conference websites, mostly, but I'm worried about the scraped content creating duplicate content issues. I've also noticed that most calendars of this type which rank well are not including actual event descriptions, but rather just names, locations and a link out to the conference website. See https://www.semrush.com/blog/the-ultimate-calendar-of-digital-marketing-events-2017/ and http://www.marketingterms.com/conferences/ . Anyone have any thoughts on this? Thanks, in ..advance..
Intermediate & Advanced SEO | | Daaveey0 -
Desktop vs. Mobile Results
When googling on www.google.ca for "wedding invitations" and in my own geo location market of Toronto, my site - www.stephita.com, will show up differently on SERP on desktop (Chrome & IE) vs. mobile (iPad, iPhone, android, etc.). On desktop SERP, I will show up 6/7 position... (which is relatively a new position, the past 3 weeks - I was previously on page 2) (After a bunch of SEO fixes, I've managed to propel my site back to page 1!) On mobile SERP, I only show up on 1/2 position on PAGE 2 😞 As I mentioned above, I did a bunch of SEO fixes that I think were related to Panda/Penguin algos. So I'm wondering why my MOBILE SERP has NOT improved along the way? What should I be looking at to fix this 5-6 position differential? Thanks all!
Intermediate & Advanced SEO | | TysonWong0 -
Content Audit Questions
Hi Mozzers Having worked on my companies site for a couple of months now correcting many issues, im now ready to begin looking at a content review, many areas of the site contain duplicate content, the main causes being 1. Category Page Duplications
Intermediate & Advanced SEO | | ATP
e.g.
Widget Page Contains ("Blue Widget Extract")
Widget Page Contains ("Red Widget Extract")
Blue Widget Page Contains ("Same Blue Widget Extract")
Red Widget Page Contains ("Same Red Widget Extract") 2. Product Descriptions
Item 1 (Identical to item 2 with the exception of a few words and technical specs)
Item 2 Causing almost all the content on the site to get devalued. Whilst i've cleared all moz errors and warnings im certain this is causing devaluation of most of the website. I was hoping you could answer these questions so I know what to expect once i have made the changes. Will the pages that had duplicate content recover once they possess unique content or should i expect a hard and slow climb back? The website has never receive any warnings from Google, does this mean recovery for penalties like duplicate content will be quicker Several pages rank on page 1 for fairly competitive keywords despite having duplicate content and keyword spammy content. What are the chances of shooting myself in the foot by editing this content? I know I will have to wait for google to crawl the pages before i see any reflection in the changes, but how long after google has crawled the page should I get a realistic idea of how positive the changes were? As always, thanks for you time!0 -
Panda Recovery Question
Dear Friends, One of my customers was hit by the Panda, we were working on improve the tiny content on several pages and the remaining pages were: 1 NOINDEX/FOLLOW 2. Removed from sitemap.xml 3. Un-linked from the site (no one page on the site link to the pour content) As conclusion we can't see any improvement, my question is should I remove the pour content pages (404)? What is your recommendation? Thank you for your time Claudio
Intermediate & Advanced SEO | | SharewarePros0 -
What is the recommended way to save Image Files in WP?
Hi, Is there a recommended setting (or even plugin) to use when saving image files on my Wordpress blog?
Intermediate & Advanced SEO | | BeytzNet
Which folders etc. Thanks0 -
Blocking out specific URLs with robots.txt
I've been trying to block out a few URLs using robots.txt, but I can't seem to get the specific one I'm trying to block. Here is an example. I'm trying to block something.com/cats but not block something.com/cats-and-dogs It seems if it setup my robots.txt as so.. Disallow: /cats It's blocking both urls. When I crawl the site with screaming flog, that Disallow is causing both urls to be blocked. How can I set up my robots.txt to specifically block /cats? I thought it was by doing it the way I was, but that doesn't seem to solve it. Any help is much appreciated, thanks in advance.
Intermediate & Advanced SEO | | Whebb0 -
Can I use a "no index, follow" command in a robot.txt file for a certain parameter on a domain?
I have a site that produces thousands of pages via file uploads. These pages are then linked to by users for others to download what they have uploaded. Naturally, the client has blocked the parameter which precedes these pages in an attempt to keep them from being indexed. What they did not consider, was they these pages are attracting hundreds of thousands of links that are not passing any authority to the main domain because they're being blocked in robots.txt Can I allow google to follow, but NOT index these pages via a robots.txt file --- or would this have to be done on a page by page basis?
Intermediate & Advanced SEO | | PapaRelevance0 -
"Iffy" Question
Hi Guys and Girls, I have been studying SEO for a few years now. I have learned quite a bit along the way. One thing that I have had BEAT in my head is "Create Quality Content". When I used to ask "What Should I do to get more visits?" I was told, "Create QUALITY CONTENT". That was great advice, and I have done that. I have created over 600 pages since then. I went from 200 visits per month to now just over 5,000. Even more importantly, I have increased my lead conversions. I say all of this because, about two years ago I told a competitor basically how you rise up in the search engines. He turned around and bought a domain that was 3 years older than mine and had a main keyword in the domain. He then just started building links with a bunch of blog comments and forum posts (The blog comments have like 2,000 comments on them). In other words, he did what I would NOT do yet he is #5 for this keyword and I am #9. (Although, I turned around and built another site and now I am at #13 for that and it has been up for a year now. I say all this, not to bore you but to tell ask you, DOES IT WORK IF YOU DO BLOG COMMENTING, FORUM POSTING, LINK WHEELS, ETC. Do you obtain higher rankings? Should I be doing a bit of video marketing? I know a lot of people will say, "Why would you spend your time on things that may slightly impact your rankings, but obviously it did something for this guy. Any help you can give would be greatly appreciated.
Intermediate & Advanced SEO | | blake-766241