SEO impact on archives and mirror services?
-
Hi,
We're looking at setting up an email archive site for certain lists related to our niche. We've been considering using archives.ourdomain.com versus ourdomain.com/archives. Part of the problem is that while the archives won't initially have huge amounts of content, over time it'll outstrip the amount of content we produce and I was worried about whether or not this would cause a duplicate content penalty as the emails will also be archived elsewhere.
If the volume of mails over time combined with duplication penalties are going to penalise the site, I'd rather we used a subdomain or a separate domain. If not, then subdomains might be the way to go.
-
I meant include this robot in the subdomain not include the subdomain in the robot. Was answering an employee at the same time and crossed some wires.
-
You have a few choices here to avoid that.
If you want to avoid it completely, simply include this entire subdomain.domain.tld in the robots.txt as:
User-agent: *
Disallow: /
Disallow: *Then place it in the root of your subdomain folder, for example if you sub was at subdomain.domain.tld you would normally have a folder called subdomain within your normal root folder.
Do not place this robots.txt file in your main folder or the whole site will not be indexed.
Extra measure, you can place a:
in the head section of each page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will SEO Blogs Divert Traffic from Main Web pages using same keywords?
Our company has drafted several SEO blogs using certain keywords. If we post these SEO blogs to our website and social media channels , and the blog keywords are also used on our main website pages, will the blogs divert or dilute traffic to our main web pages? Thank you for your expertise and insights in advance.
Content Development | | Johnenchroma0 -
Use old content from Archive
Hello all, I just were looking on Archive.org and though what if i use the content from a really old website thats already been un-indexed. Could i just use this content on my new website and will it not be duplicate content? Thank you for your comment! Kind regards,
Content Development | | MennoO0 -
Is Wordpress good for SEO
Is Wordpress good for SEO? If so, any tips? Do I need to set up as a subdomain so www.blog.mysite.com? Thanks
Content Development | | Studio330 -
Advice on the layout on this page for user experience and seo
Hi, we are testing a new website using wordpress, we have never used wordpress before and normally use joomla so we would like some advice to make sure the page below is good user experience, good for seo and the layout of the page including text style and size and paragraph space is ok would love your feedback here is the page http://www.cheapflightsgatwick.com/david-cameron-economic-rescue-plans-fail-as-families-are-forced-to-give-up-holidays/
Content Development | | ClaireH-1848860 -
Will a comment section on my site help with seo
I have never been a fan of comment pages such as the sun http://www.thesun.co.uk/sol/homepage/showbiz/tv/4783642/bruce-willis-appears-on-the-one-show-in-awkward-interview.html but i was told the other day that not only is it good for the reader but it is also good for seo and increase the number of times that google would visit the page and i would like to know if that is true. if you have added a comment section to your articles i would like to know if you have noticed any change.
Content Development | | ClaireH-1848860 -
Archiving old blog posts - yea or nay?
I'm building up my personal website. When I moved from my old domain to my current one a few years ago, I had moved a folder with all my old blog posts (from an old blogger.com account) to an archives called /blog/. It's bad enough the entries just text and nearly all the images aren't there but because of the way I moved over the posts, I have 200+ duplicate page titles with no meta descriptions. Is it worth saving these posts ? (putting them into an archives.mysite.com sub-domain?) I already have the folder disallowed in my robotos.txt file and there's nothing really incredible content-wise in the archives, though they are some of the oldest pages on my current (3 years old) domain. There's no real SEO thought in them as this was just a fun personal blog at the time. Thoughts?
Content Development | | JamesDziezynski0 -
Quality content distribution service?
I want to distribute my articles without having to go multiple sites to get the job done. What is the best quality and most reputable company to help me distribute my content?
Content Development | | photoseo10 -
Does anyone have some examples of Ecommerce websites that have great product reviews that are SEO friendly?
I am trying setup product reviews on an Ecommerce site and was wondering if there were some good websites to create a model around that is SEO friendly. Right now my reviews are in a separate directory off the review (http://www.example.com/review/product/etc) and I would like my reviews to be attributed to the product page to add in free, fresh, unique content that contains valuable information for both the user and SEO (new keyword derivatives). Also any suggestions on getting users to leave reviews? Whether it is a monetary incentive/coupon or a free method (of course this is preferred :)) Thanks in advance!
Content Development | | ResponseMine0