Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Irrelevant Subfolders?

Technical SEO

624

Blobe last edited by

I have my root domain and as I am a web designer, I use subfolders as sandboxes for client websites. I would not like these to be searched though because they are just demos, ideas and such. Would this be a robots.txt matter or can I have SEOMoz wok with a campaign where I can exclude subfolders? Thank you in advance! : )
1 Reply Last reply
Reply Quote 0
Keszi last edited by

Hi Wil,

If you want to exclude all robots from crawling these pages you can exclude them from Robots.txt.

If you want to exclude Rogertbot you can find the info on how to do it on: http://www.seomoz.org/dp/rogerbot

I hope that helped,

Istvan
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

404s on subfolder - how to redirect?

404s redirects

Hi all,
we have a lot of 404s to subfolders. Eg
www.website.com/blog-post-title/imagename/
www.website.com/blog-post-title/author/ We don't have these subfolders or blog posts anymore.
How do i redirect them? These links (404s) don't seem to have any value or backlinks. Thanks,
Stef
Technical SEO | | MFSMarketing

0
Is having my homepage on a subfolder harmful?

Hi guys, I am the webmaster of the following two websites: www.gpblog.com/nl
www.gpblog.com/en The first URL is the Dutch version of GPBlog, the second URL is the UK version of GPblog. Whenever a person visits www.gpblog.com he gets redirected to either the Dutch version or the UK version based on his location. My question is: is it harmful to have 1. your homepage on a subfolder and 2. is it harmful to run two different languages on one domain using this technique? Thank you in advance!
Technical SEO | | NielsDE

1
Is it a good idea to direct a new url to a subfolder?

Hello everyone, I have a client who is in public relations. He is wanting to integrate SEO into his business and is hiring me to help. He purchased a domain that is separate from his existing website, but wants to keep the services and existing blog (which will include SEO) on his current site. For example, he has: www.example.com and wants to add a SEO folder which will contain our services: www.example.com/prseo the domain he purchased (as another example) is: www.prseo.com but wants to direct it to the folder he has set up @ example.com/prseo Can anyone offer advise? Is this a good idea?
Technical SEO | | visabelmedia

0
SEO Problems with Loading to a Subfolder?

A client has a single page app website that shows https://example.com/example when you visit https://example.com . I don't think this is a redirect; I think it's a URL rewrite. My questions: Is this setup common with single page apps? What are the SEO benefits or drawbacks of having a domain's homepage load, rewrite, or redirect to a subfolder?
Technical SEO | | Kevin_P

0
Url rewrite subfolder

Hi, How can i rewrite example.com/example1/example2/example3 to example.com/example3 And is there tools or software that can generate url rewrite... (not a plugin) Thanks !
Technical SEO | | bigrat95

0
How to redirect subfolder on different domain to another but same ftp

Hi i was wondering how can we redirect all subfolder under language repertory from a domain name to another domain name. The thing is that these 2 domain are on the same IP. Exemple Domain1.com/en to Domain2.com/en Domain1.com/fr to Domain2.com/fr I already redirected my domain with this code RewriteEngine On RewriteCond %{HTTP_HOST} !^www\.olddomain\.com$ RewriteRule (.*) http://www.newdomain.com/$1 [R=301,L] RewriteCond %{HTTP_HOST} !^olddomain\.com$ RewriteRule (.*) http://www.newdomain.com/$1 [R=301,L] Should i apply this code in my .htacces in the subfolder fr and en?
Technical SEO | | bigrat95

0
Crawling a subfolder with a dev site

I am trying to set up a campaign where I am crawling a subfolder of our main site where I have dev version of the new site. However, even though the new site resolves and I have included the full resolving URL but the crawl results come back saying that only one page has been crawled. The site has had a protected block on it for a period of time but this has now been removed. Any ideas? Thanks Nick
Technical SEO | | Total_Displays

0
How to move my blog from subdomain to subfolder?

Not an unusual situation, I have a blog on blog.domain.com it has quite a few blog postings. The platform is old and will be scrapped, but the blog content itself is going to be moved to domain.com/blog. The current process is we are manually listing all linked to/content pages and we are going to 301 redirect them to their counterparts on the new blog. This is going to be a tedious process. A) Is there any way to automate the moving of the blog? B) What is the best way to do the massive 301 redirect, php headers, .htaccess? Should we move the individual pages with redirects, or redirect the domain in the .htaccess (this will be very difficult to match all the titles and file structure)?
Technical SEO | | MarloSchneider

0