Duplicate Sub-domains Being Indexed
-
Hi all,
I have this site that has a sub-domain that is meant to be a "support" for clients. Some sort of FAQ pages, if you will. A lot of them are dynamic URLs, hence, the title and most of the content are duplicated.
Crawl Diagnostics found 52 duplicate content, 138 duplicate title and a lot other errors.
My question is, what would be the best practice to fix this issue? Should I noindex and nofollow all of its subdomains? Thanks in advance.
-
Thanks a lot! I will definitely try that.
-
If you don't want these indexed, first put a noindex tag on all pages. Leave the follow alone as the engine still needs to find the pages to change the index status.
Add the domain to GWMT then request a removal all the pages.
Allow this to take effect then add a robots disallow to the entire sub-domain.
Your domain then be cleaned from the index and the duplication won't be an issue.
-
The site has a few subdomains. For example (below examples are not my site):
- https://support.medialayer.com/index.php?_m=knowledgebase&_a=view
- https://support.medialayer.com/index.php?_m=knowledgebase&_a=viewarticle&kbarticleid=9&nav=0
So basically, the pages got indexed, with the same title, and partial/whole duplicate content.
So, by simply making some changes on the robots.txt will fix this issue? Thanks.
-
How are all of these subdomains being created? Do you have just one subdomain you are worried about or multiple subdomains?
If you can do a robots.txt disallow on certain duplicate folders/files that you don't want indexed, that might help.
Let me know some more info first.
Scott.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sub Directories Domain & Page Crawl Depth
Hi, I just bought an old domain with good backlinks and authority, that domain was technology product formerly. So, I want to make this domain for my money site. The purpose of this website is to serve technological information like WordPress tutorial and etc (free software or drivers). And I just installed a sub directory on this domain like https://maindomain.com/subdirectory/ and this directory I made for a free software like graphics drivers download (NVIDIA or AMD). What you think with this website? Is it make sense? Wait, I just added this domain to my campaign at MOZ and the result shown my sub directory was 6 times of crawl depth. Is it good for directory or I need to move the sub directory to my main site? Thank you, hope someone answer my confuse. Best Regard, Matthew.
Intermediate & Advanced SEO | | matthewparkman0 -
Keyword Rich Domain
We purchased a keyword rich domain name to use with an existing website. What is the best way to use this domain? Below are some thoughts, I welcome any input. Use this domain as an add-on to the main domain, but only have it load one page off the main domain? Would that cause duplicate content issues? Create a single static page of content for the domain (separate from main domain) Redirect domain to page on master domain, would we loose any benefits of the keyword rich domain? Thank you!
Intermediate & Advanced SEO | | idlwebinc0 -
Sub-domain or new domain for new location
I have a small law firm in Dallas, TX. I will be moving to Austin, TX in the next 2 years. My website is doing great here in Dallas, but I have focused on keyword phrases that include the word "Dallas." I would like to leave my current website as is and maintain a Dallas office to keep the business flowing from this website. I am trying to determine the best way to get Austin business from a 2nd website. I know I will need new content that includes the use of the word "Austin". My question is: Should I put the new content on (1) a subdomain (i.e. austin.copplaw.com) or (2) a new domain (i.e. copplawfirm.com). I really want to be a player for the google local search results in both cities. I can use a different name for my law firm in Austin, if necessary. Any advice would be greatly appreciated! Regards, Zac
Intermediate & Advanced SEO | | seozac0 -
Multiple domains expiring that have 301 redirects to my primary domain. Am I in trouble?
I recently took on the SEO of a large website with http://example.com. My predecessor bought 40 plus domains for specific cities like Jacksonvilleexample.com, Miamiexample.com, etc. ZERO of the additional domains linked to our main website. The domains that were bought basically had our exact same website in terms of content, links etc that mirrored our main http://example.com. I added 301 redirects to help problems that may be a result of this type of structure. Some of the additional domains were indexed and some were not but all have 301's and as far as traffic is concerned I'm not worried about loosing short term traffic. My question: All the domains are set to expire in June and I don't want to continue to have them 301 redirected to my main domain (example.com). I'm not trying to avoid the additional cost of all the domains but I don't see an advantage to having them so CAN letting all these domains expire hurt me from a long term SEO position if I don't renew them?
Intermediate & Advanced SEO | | ballanrk0 -
Indexing techniques
Hi, I just want a confirmation about my indexing technique, if is good or can be improved. The technique is totally whitehat and can be done by one person. Any suggestions or improvements are welcome. I create the backlinks ofcource first 🙂 I make a list on public doc from Google. On the doc are only ten links. After I digg it , and add some more bookmarks 5-6. I tweet the digg and each doc. (my 2 twitter accounts have page authority 98) I like them in Fb. I ping them thru ping serviecs. Thats it. Works ok for moment. Is anything what I can do to improve my technique? Thanks lot
Intermediate & Advanced SEO | | nyanainc0 -
Latent Semantic Indexing and Direct Match Domains
I wondered if anyone had any opinions as to whether LSI plays any part in the ranking of a direct match domain? For example :- would www.search-engine-optimisation.com be more likely to rank better for search terms such as 'SEO Services' or 'SEO Experts' than www.some-random-domain.com Does having 'Search Engine Optimisation' in the domain name mean that you would rank better for 'SEO'?
Intermediate & Advanced SEO | | AdeLewis0 -
IP address being indexed by Google in addition to canonical domain.
Our site's IP address is being indexed in addition to the canonical www.example.com domain. As soon as it was flagged a 301 was implemented in the .htaccess file to redirect the IP address to the canonical. Does this usually occur? Is it detrimental to SEO? In my time in SEO I've never heard of this being an issue, or being part of a list of things to be checked. It sounds more like a server that wasn't configured correctly when hosting was set up? It didn't seem to be affecting the site at all, but is it more common and I've just never heard of it? 😛 Should it be something I'm usually looking for in future? Responses are greatly appreciated!
Intermediate & Advanced SEO | | mikeimrie0 -
Duplicate page Content
There has been over 300 pages on our clients site with duplicate page content. Before we embark on a programming solution to this with canonical tags, our developers are requesting the list of originating sites/links/sources for these odd URLs. How can we find a list of the originating URLs? If you we can provide a list of originating sources, that would be helpful. For example, our the following pages are showing (as a sample) as duplicate content: www.crittenton.com/Video/View.aspx?id=87&VideoID=11 www.crittenton.com/Video/View.aspx?id=87&VideoID=12 www.crittenton.com/Video/View.aspx?id=87&VideoID=15 www.crittenton.com/Video/View.aspx?id=87&VideoID=2 "How did you get all those duplicate urls? I have tried to google the "contact us", "news", "video" pages. I didn't get all those duplicate pages. The page id=87 on the most of the duplicate pages are not supposed to be there. I was wondering how the visitors got to all those duplicate pages. Please advise." Note, the CMS does not create this type of hybrid URLs. We are as curious as you as to where/why/how these are being created. Thanks.
Intermediate & Advanced SEO | | dlemieux0