SEO impact on archives and mirror services?
-
Hi,
We're looking at setting up an email archive site for certain lists related to our niche. We've been considering using archives.ourdomain.com versus ourdomain.com/archives. Part of the problem is that while the archives won't initially have huge amounts of content, over time it'll outstrip the amount of content we produce and I was worried about whether or not this would cause a duplicate content penalty as the emails will also be archived elsewhere.
If the volume of mails over time combined with duplication penalties are going to penalise the site, I'd rather we used a subdomain or a separate domain. If not, then subdomains might be the way to go.
-
I meant include this robot in the subdomain not include the subdomain in the robot. Was answering an employee at the same time and crossed some wires.
-
You have a few choices here to avoid that.
If you want to avoid it completely, simply include this entire subdomain.domain.tld in the robots.txt as:
User-agent: *
Disallow: /
Disallow: *Then place it in the root of your subdomain folder, for example if you sub was at subdomain.domain.tld you would normally have a folder called subdomain within your normal root folder.
Do not place this robots.txt file in your main folder or the whole site will not be indexed.
Extra measure, you can place a:
in the head section of each page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How important is exact keyword match in content for SEO in 2018?
Is it necessary to have the exact keyword which you are trying to rank for within the first sentence of the content on your web page? For example if we are selling men's shoes, is it ok to have have the meta title and h1 on page say men's shoes and just talk about shoes within the first sentence of the content on the page. Is it obvious to search engines that this page is selling men's shoes even if you don't have the word men's shoes in that first sentence or is it necessary to have the exact keywords which you are trying to rank for written there?
Content Development | | whiteonlySEO0 -
Use old content from Archive
Hello all, I just were looking on Archive.org and though what if i use the content from a really old website thats already been un-indexed. Could i just use this content on my new website and will it not be duplicate content? Thank you for your comment! Kind regards,
Content Development | | MennoO0 -
Content Syndication Service
Am curious to get the forum's opinion on content syndication services like SYNND . Has anyone tried them or any other content syndication networks. Does the forum have any recommendations for good quality syndication networks that can be used to distribute content to quality sources.
Content Development | | SEO5Team0 -
Is Wordpress good for SEO
Is Wordpress good for SEO? If so, any tips? Do I need to set up as a subdomain so www.blog.mysite.com? Thanks
Content Development | | Studio330 -
Disqus and SEO
It seems Disqus commenting system has grown and evolved so to make it easier to comment I've installed it on my 14 sites. I find moderation becomes much easier. Is Disqus SEO friendly and a part of an SEO process? (I checked the topic and only found one's dated back to 2011). Thanks, Don
Content Development | | NicheGuy0 -
Blogger Outreach - have you used this service before?
Hi, Has anyone used blogdash.com before? It says it has over 100,000 blog owners registered, which does sound good but when you look at the sites own social following its very poor and when you start to dig a little deeper you can find blog owner profiles like this: http://www.blogdash.com/blogger/ari-herzog First view, you think Ari Herzog has signed up to Blog Dash and you can pitch him content for blogs such as Huffington Post and Mashable, took about 10 seconds to realise he isn't actually part of the network as the yellow box is asking him to signup if he ever finds that page. Has anyone used this service? I can imagine 2% out of the 100,000 are actually members who have signed up.
Content Development | | activitysuper0 -
Quality content distribution service?
I want to distribute my articles without having to go multiple sites to get the job done. What is the best quality and most reputable company to help me distribute my content?
Content Development | | photoseo10 -
How do blogs affect seo?
Could you help me understand how blogs affect seo and how this works specifically when a blog is located within a site? Thank you!
Content Development | | derrickkuhn0