Thank you. I want to disallow specific URLs on the subdomain and add the shop sitemap in the robots.txt file. So I'll go ahead and create another!

Currently we just have: User-agent: *

I'm in the process of optimising.

Hello Mozzers!

Apologies if this question has been asked before, but I couldn't find an answer so here goes...

Currently I have one robots.txt file hosted at https://www.mysitename.org.uk/robots.txt

We host our shop on a separate subdomain https://shop.mysitename.org.uk

Do I need a separate robots.txt file for my subdomain? (Some Google searches are telling me yes and some no and I've become awfully confused!