Consolidating a Large Site with Duplicate Content
-
I will be restructuring a large website for an OEM. They provide products & services for multiple industries, and the product/service offering is identical across all industries.
I was looking at the site structure and ran a crawl test, and learned they have a LOT of duplicate content out there because of the way they set up their website.
They have a page in the navigation for “solution”, aka what industry you are in. Once that is selected, you are taken to a landing page, and from there, given many options to explore products, read blogs, learn about the business, and contact them. The main navigation is removed.
The URL structure is set up with folders, so no matter what you select after you go to your industry, the URL will be “domain.com/industry/next-page”.
The product offerings, blogs available, and contact us pages do not vary by industry, so the content that can be found on “domain.com/industry-1/product-1” is identical to the content found on “domain.com/industry-2/product-1” and so-on and so-forth.
This is a large site with a fair amount of traffic because it’s a pretty substantial OEM. Most of their content, however, is competing with itself because most of the pages on their website have duplicate content.
I won’t begin my work until I can dive in to their GA and have more in-depth conversations with them about what kind of activity they’re tracking and why they set up the website this way. However, I don’t know how strategic they were in this set up and I don’t think they were aware that they had duplicate content.
My first thought would be to work towards consolidating the way their site is set up, so we don’t spread the link-equity of “product-1” content, and direct all industries to one page, and track conversion paths a different way. However, I’ve never dealt with a site structure of this magnitude and don’t want to risk messing up their domain authority, missing redirect or URL mapping opportunities, or ruin the fact that their site is still performing well, even though multiple pages have the same content (most of which have high page authority and search visibility).
I was curious if anyone has dealt with this before and if they have any recommendations for tackling something like this?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hi i have a few pages with duplicate content but we've added canonical urls to them, but i need help understanding what going on
hi google is seeing many of our pages and dupliates but they have canonical url on there https://www.hijabgem.com/index.php/maxi-shirt-dress.html has tags https://www.hijabgem.com/maxi-shirt-dress.html
On-Page Optimization | | hijabgem
has tagshttps://www.hijabgem.com/index.php/quickview/index/view/id/4693
has tags
my question is which page takes authority?and are they setup correct, can you have more than one link rel="canonical" on one page?0 -
Does CloudFlare Benefit my site?
I am using the $20 / month CloudFlare service. My site is not running faster, so my question is: is this service adding real value? I do not have a lot of highly sensitive customer data (some email addresses and customer names and nothing more - no credit cards). I am already using Amazon Cloud Server and it appears to work fine. Any thoughts appreciated.
On-Page Optimization | | khi50 -
Should I use nofollow when interlinking large, networked sites?
My company runs a network of very large networked sites, each with thousands of content pages. In our main navigation we are currently not nofollowing links between these networked sites. The links appear on every single page in the top navigation, and there are thousands of pages on each site. I am worried this will look to Google like we have suspiciously received thousands of links from one domain - one link from every page on the domain. Should we be nofollowing these navigation links between the different sites in our network?
On-Page Optimization | | Natasha90040 -
How to check duplicate content with other website?
Hello, I guest that my website may be duplicate contents with other websites. Is this a important factor on SEO? and how to check and fix them? Thanks,
On-Page Optimization | | JohnHuynh1 -
Does schema.org assist with duplicate content concerns
The issue of duplicate content has been well documented and there are lots of articles suggesting to noindex archive pages in WordPress powered sites. Schema.org allows us to mark-up our content, including marking a components URL. So my question simply, is no-indexing archive (category/tag) pages still relevant when considering duplicate content? These pages are in essence a list of articles, which can be marked as an article or blog posting, with the url of the main article and all the other cool stuff the scheme gives us. Surely Google et al are smart enough to recognise these article listings as gateways to the main content, therefore removing duplicate content concerns. Of course, whether or not doing this is a good idea will be subjective and based on individual circumstances - I'm just interested in whether or not the search engines can handle this appropriately.
On-Page Optimization | | MarkCA0 -
Mobile blog creating duplicate title and content issues
My site is set up with a mobile website and after running the on page SEO report on moz it is returning multiple errors for duplicate title tags and duplicate content all related to the mobile website being a direct reflection of the main site. I want to know if this is really an issue. I'm sure Google actually knows the difference between my main site and the mobile version. Do I really need to go through each individual mobile page and change each page title and modify all the content? I really would like to avoid doing this but at the same time would like to fully optimize my site. Any advice is appreciated.
On-Page Optimization | | shiftins0 -
Duplicate content on my domain
I have several pages on my domain that are using the same content except for changing a paragraph or sentence. Do I need to create unique content, even though much of the information pertains to a feature and is related?
On-Page Optimization | | Court_H0 -
Internal link structure for large site
I am working on a very large directory site which is undergoing a complete redesign. I am considering the internal link structure from first principles. When a site has over 100,000 pages, how do you ensure that each page is linked to from somewhere so that there are no orphans? Trying to get my head around the structure makes my brain hurt. Any tips?
On-Page Optimization | | mascotmike0
