Duplicate content across domains
-
I have a client with 2 websites - one is a trucking and rigging company that specializes in installation / moving / removal of safes (site #1), the other offers a product line of safes (site #2). I originally designed / implemented site #1 and was able to get "safe installation New York", "safe moving New York", and "safe removal New York" in the top 3 search results in. A little over a year ago, client was approached by another marketing company to create the site #2, who also provided commercial services that I don't. It was a business decision, and we remained in good relations. As a result Site #1 went to the new marketing company and they built Site #2.
Fast forward to about 3 months ago - Site #1 was infected with malware, client wasn't happy with new service, and asked me to take back the Site #1 ( and remove malware), and take Site #2, and re-work the SEO. SEO had dramatically fallen off for Site #1, so I've been working the SEO once I was able to get the malware completely removed and reviewed by Google.
Site #1 had been redesigned by the other marketing company, essentially retaining the content that I created. Site #2 has mostly new content, but under "Services", it references the same services that Site #1provides, but the content is exactly the same, except that references to the company for Site #1 also link to Site #1. So there is duplicate content for 5 pages on both sites. As it happens, Site #2 that SELLS safes, is ranking #2 for "safe installation new york" for exactly the same content as Site #1 that provides the services. Site #1 ranks >50 for the same keyphrase.
Why would this be? Has Site #2 taken the lead on this keyphrase because of the malware situation and now Site #1 is being penalized for duplicate content?
One other major change on Site #1 is that the web technician used Wordpress's built in page nesting (page is set as child to parent page - nested 3 deep in some cases). What are the consequences (if there are any) of having a page listed as (for example) oztruckingandrigging.com/services/safe/safe-installation vs. oztruckingandrigging.com/safe-installation? The reason I ask this is that when I Moz page optimize for the first one for "safe installation" I get a lower grade then when I Moz page optimize for the second one.
-
I don't have direct control, but I believe there is a strong partnership (perhaps even a partial ownership) between my client and the target site. I didn't develop the safewarehouseofnewyork.com site, I have only been tasked with working the SEO. But this sounds really bad - I'm heading out the door (to the beach, it's Sunday ), and will look into this more thoroughly when I return.
I never did like the way the site designer didn't incorporate the products into the site and goes to a different site based on product line. Not the way I would do it, but maybe the client was trying to keep the cost down.
-
FYI I thought I would let you know I was going through your navigation and noticed in the product section you are making a new window or tab most of the time when clicking a link that is on the same domain.
http://safewarehouseofnewyork.com/products/superior-safe-company/ click first read more
The reason I'm bringing this up is much more important you mentioned that you were hacked.
I clicked on a URL in your product area which took me to a third-party company selling the product. What bothered me was several errors when I checked it using Sucuri.net
I found out that the site is compromised, and I would recommend if it is under your control letting the people who administer the site know ASAP you do not want to link to a hacked site.
https://sitecheck.sucuri.net/results/www.ftknox.com/store/
If your site was hacked and you are linking directly to these other sites inside your products area, I would not divert people from my site unless I had an excellent reason.
If these are under your umbrella you will want to fix this ASAP
You can check for malware and get sites fixed very easily using https://sitecheck.sucuri.net/
- PHP error: Fatal error: Call to protected pluginSedLex::__construct() fro
Fatal error: Call to protected pluginSedLex::__construct() from invalid context in /nfs/c03/h03/mnt/52872/domains/ftknox.com/html/wp-content/themes/fortknox/sidebar.php on line 44
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/store/ ( View Payload ) |
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/vaults/the-maverick-vault/ ( View Payload ) |
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/store/ ( View Payload ) |<code>**Site error detected. Details: http://sucuri.net/malware/php-error-fatal-error?v6** **Fatal error**: Call to protected pluginSedLex::__construct() from invalid context in **/nfs/c03/h03/mnt/52872/domains/ftknox.com/html/wp-content/themes/fortknox/sidebar.php** on line **44**</code>
-
There is a saying in SEO cool links do not change. If you are creating new links ideally, in my opinion, the shorter the URL the better. As long as it is of course descriptive
"I am not having a problem with the "function" of the site. My question relates to best practices for SEO - would it be better to have the URL be simply oztruckingandrigging.com/safe-installation or is it basically equivalent to have the URL be as it is, oztruckingandrigging.com/our-services/safes/safe-installation/."
I would recommend a URL like a number one over number two
- http://oztruckingandrigging.com/safe-installation (for usability this is much better considering the length of your domain as well)
- http://oztruckingandrigging.com/our-services/safes/safe-installation ( you have the same word twice in this URL not good)
See
- https://moz.com/blog/15-seo-best-practices-for-structuring-urls
- https://www.woorank.com/en/blog/url-optimization-5-best-practices-for-seo
**Duplicate content is addressed here in an extremely thorough manner. **
-
http://www.hobo-web.co.uk/duplicate-content-problems/ (This is the most relevant and thorough)
imagine what Google does to sites that reuse content and imagine if it's a different domain only one will be indexed ( most of the time) a great explanation is in this video. This might not feel like it is relevant to multiple domains but it is because all of it's in Google's index already.
https://youtu.be/nMrYeUWlslY?t=5m41s
Using duplicate content across domains, I do not suggest using because of what I stated above that the site would more authority will take all credit for the content.
I hope this helps,
Tom
-
There is no official duplicate content penalty from Google. If that is what you are asking? Now it's two sites have identical conte there is no official duplicate content penalty from Google. If that is what you are asking? Now if two sites have identical content and Google Will give the domain with a higher authority the higher ranking for the exact same term. But this would mean that are identical in terms of every single manner except for Domain Athorthy the rights to the content only become googles concern when you file a digital millennium take down act. Or DMCA you would not do this in your situation you would only do this in a situation where somebody else is useing your content.
So when Google chooses the flight that gets the authority for the content they will choose one of the two sites or one of however many sites have not content on the index after which the sites with the identical content will not ran so when Google chooses the site that gets the authority for the content they will choose one of the two sites or one of however many sites have not content on their index after which the sites with the identical Content will not benefit from the content that is already indexed and ranking on a higher authority domain.
There are exceptions for every rule every site is unique Google needs to decipher which thinks is the best for the end-user remember Google is in business as a search engine for end-users not for us SEO , Devs, or site owners. The amount of factors that goes into the decision is so much higher than what I want to get into right now but if somebody has a higher rate has people with more time on site has proven that their site present a better user experience actually help make websites for
Google likes unique high quality fresh content and can figure out what is best for users there's a huge difference between a penalty and serving the ideal page to the end user. So while theoretically it is possible to rank #1 using identical content it is not something I would recommend.
I can see that you're hosting with Wiretree I am in a supermarket on my telephone right now so I will lose my mind when I am not in front of my computer however I just wanted to update you on Content and please excuse any spelling or grammar glitches.
Tom
-
My apologies - I should have referenced "our-services" instead of "services", no minor detail.
- Are you using a particular WordPress hosting company?
I host the sites on my dedicated server and provide wordpress maintenance - Do you have a specific plug-in that you're using to create redirects?
I do, but I did not redirect these URLs - Do you create redirects by using either PHP, Apache, Nginx or Varnish?
I use a redirect plugin - but good point, it's possible that the previous developer added 301 redirects in .htaccess. I believe, though, that this is done by native Wordpress based upon the relationship between the primary domain, and the parent pages. - How familiar are you with your database?
Familiar enough to find issues in it via phpadmin. Again this is a Wordpress site, and it's not a frequent requirement that I modify the database directly - Did you do a search and replace when you moved or migrated the site?
The structure, domain and navigational URLs of the site did not change. I received a zip file of the database from the previous site manager, and I FTPd the files from the original location.
***ACTUAL QUESTION: I am not having a problem with the "function" of the site. My question relates to best practices for SEO - would it be better to have the URL be simply oztruckingandrigging.com/safe-installation or is it basically equivalent to have the URL be as it is, oztruckingandrigging.com/our-services/safes/safe-installation/ ***
Again, the site works the way it is supposed to - I do see a few 404s unrelated to this question that I need to clean up, and I very much appreciate the additional resources you have provided me. You put together a very thorough answer, but I think it wasn't clear the question I was actually asking. I do already have the free version of Screaming Frog, but I am unfamiliar with the others.
I still am not sure of the answer for the initial question regarding duplicate page content across two different sites and whether there is a penalty.
Thank you!
- Are you using a particular WordPress hosting company?
-
Ok, You are using child and parent pages? That is what is causing the /safe/safe/ you are redirecting to a forward slash "/" but they're not duplicates because their 301 redirects they're not just forwarding there actually Telling Google this is no longer the URL is the new one.
I would have to see what you're using to create redirects it most likely is a regex or plug-in setting.
- Are you using a particular WordPress hosting company?
- Do you have a specific plug-in that you're using to create redirects?
- Do you create redirects by using either PHP, Apache, Nginx or Varnish?
- How familiar are you with your database?
- Did you do a search and replace when you moved or migrated the site?
According to
http://www.redirect-checker.org/index.php
http://oztruckingandrigging.com/safes/safe-installation
301 Moved Permanently
http://oztruckingandrigging.com/our-services/safes/safe-installation/
200 OKHTTP Headers
301 Moved Permanently
| Status: | 301 Moved Permanently |
| Code: | 301 |
| Date: | Fri, 22 Jul 2016 14:57:59 GMT |
| Server: | Apache |
| P3P: | CP="NOI" |
| Expires: | Wed, 11 Jan 1984 05:00:00 GMT |
| Cache-Control: | no-cache, must-revalidate, max-age=0 |
| Pragma: | no-cache |
| Set-Cookie: | PHPSESSID=b1ebec8c1eb3d19a6731cdab6f3187e7; path=/ |
| Location: | http://oztruckingandrigging.com/our-services/safes/safe-installation/ |
| Vary: | Accept-Encoding |
| Content-Length: | 0 |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |http://oztruckingandrigging.com/our-services/safes/safe-installation/
200 OK
| Status: | 200 OK |
| Code: | 200 |
| Date: | Fri, 22 Jul 2016 14:58:00 GMT |
| Server: | Apache |
| Accept-Ranges: | bytes |
| Content-Length: | 76093 |
| Vary: | Accept-Encoding |
| Cache-Control: | max-age=0, public |
| Expires: | Fri, 22 Jul 2016 14:58:00 GMT |
| X-Powered-By: | WP Rocket/2.8.5 |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |http://oztruckingandrigging.com/safes/safe-installation
redirects to
http://oztruckingandrigging.com/our-services/safes/safe-installation/ (forward /)
not
http://oztruckingandrigging.com/services/safes/safe-installation (no "/" it a 404)
404 Not Found
HTTP Headers
http://oztruckingandrigging.com/services/safes/safe-installation
404 Not Found
| Status: | 404 Not Found |
| Code: | 404 |
| Date: | Fri, 22 Jul 2016 15:00:06 GMT |
| Server: | Apache |
| P3P: | CP="NOI" |
| Expires: | Wed, 11 Jan 1984 05:00:00 GMT |
| Cache-Control: | no-cache, must-revalidate, max-age=0 |
| Pragma: | no-cache |
| Link: | <http: oztruckingandrigging.com="" wp-json="">; rel="https://api.w.org/"</http:> |
| Set-Cookie: | PHPSESSID=3a1bd33b57cabd2fb804d5c5cc42365b; path=/ |
| Vary: | Accept-Encoding |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |it 404's http://d.pr/i/19KcJ
http://oztruckingandrigging.com/safe-installation
301 Moved Permanently
http://oztruckingandrigging.com/safe-installation-news/ ( note the forward slash "/" on all these)
200 OK>>> http://oztruckingandrigging.com/safe-installation
"The site wasn't rebuilt completely, they changed themes (appearance) only, the page management structure (see page manager description above) - the content and general navigational structure remains the same. It just looks different, which should make no difference to Google."
Changing the theme can modify a lot of code. Go into Google Webmaster tools or search console
Here https://www.google.com/webmasters/tools/home?hl=en
Then go to crawl errors and look for 404's obviously there are going to be some 404's when modifying themes because even if all your URLs stay the same way all your URIs will not. Either way, all your URLs will not stay the same way, and you change the theme.
After which I would strongly recommend using two toolsets right now you can use https://deepcrawl.com for free it will show you everything wrong with your site. Via https://app.deepcrawl.com
Another tool I would use that is extremely helpful is
https://www.screamingfrog.co.uk/seo-spider/ there is a free and paid version for right now try the free and I think you'll be happy with the results. Obviously, 99 UK a year is not much to pay.
http://www.siteliner.com/ is designed to show you duplicate content on page and redirects it is excellent at sniffing out duplicate content I would use all three tools.
"Why would Moz Page Optimization see these two pages differently? "
Because there are multiple words in the URL that make them different. Also, there may be some settings that are slightly different in your on the page I have not looked.
the safe installation page ( the links do not go live in less you make them you links.)
Rel="canonical"
http://safewarehouseofnewyork.com/services/safe-installation/ -
I have no crawl errors / no 404s - and the nesting I refer to looks like this on the page manager dashboard in WordPress:
Services
-Safes (page parent is Services)
--Safe Installation (page parent is Safes)So Services is a page, Safes is a page, and Safe Installation is a page. You can get to oztruckingandrigging.com/services/safes/safe-installation by going to oztruckingandrigging.com/safes/safe-installation, as well as oztruckingandrigging.com/safe-installation. I find it odd that the Page Optimization score is 92% for the first, but 96% for the last? Why would Moz Page Optimization see these two pages differently? All their Services are layed out the same way (i.e. safe moving, safe removal, safe storage have "Safes" as a parent and , of course, "Services" as the Safes parent.
And the site wasn't rebuilt completely, they changed themes (appearance) only, the page management structure (see page manager description above) - the content and general navigational structure remains the same. It just looks different, which should make no difference to Google.
I still am trying to wrap my head around the fact that Safewarehouseofnewyork.com's safe installation page is #2 for Safe Installation New York (behind homeadvisor.com 5 best safe installers in New York), whereas oztruckingandrigging.com's safe installation page (which has exactly the same content) ranks >51.
I am considering changing the safe warehouse site to have a landing page for Services with references and links to each safe service that they partner with OZ trucking on. Thoughts? I hate losing that #2 ranking, though.
-
There is no real Google penalty for content duplication. Unless you're talking about stealing content which then digital millennium takedown acts
http://www.copyright.gov/legislation/dmca.pdf
It does not sound like you are talking about stealing content.
"Site #1 had been redesigned by the other marketing company, essentially retaining the content that I created. Site #2 has mostly new content, but under "Services", it references the same services that Site #1provides, but the content is exactly the same, except that references to the company for Site #1 also link to Site #1. So there is duplicate content for 5 pages on both sites. As it happens, Site #2 that SELLS safes, is ranking #2 for "safe installation new york" for exactly the same content as Site #1 that provides the services. Site #1 ranks >50 for the same keyphrase."
How can they rank identically for the same key phrases? It would make sense that a site being rebuilt completely would lose a tremendous amount of traffic in some cases.
- https://www.deepcrawl.com/knowledge/tag/migration/
- https://moz.com/blog/how-to-avoid-an-seo-disaster-when-changing-your-website
- https://moz.com/blog/web-site-migration-guide-tips-for-seos
- to fix
- https://www.screamingfrog.co.uk/seo-spider/
- https://www.deepcrawl.com
Look in Webmaster tools for 404's look for issues with your site structure and try to find out as much as you can from the other company about the way it was built. It sounds like you're talking about nesting giving you a 404 is this correct?
I would make sure that the content is only on one of the sites and not being utilized on both of them as it does not help to have duplicate content. Please understand what I said about penalties and best practices are very different.
Respectfully,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Exact Match Domain really works?
Hey!
Keyword Research | | ayofztk
I heard that exact match domain is helpful in ranking over popular keywords. I have two websites Tech Crunch SmallSEOTools My question is, will it be helpful to rank over Tech Crunch and SmallSEOTools, respectively?0 -
Is content really king?
I have a good sized website with lots of pages. Many pages are designed around specific keywords and for the most part, they rank well. I have many pages packed with good content that don't rank well, but the keywords are related to those pages that score well. Are the under performing pages contributing to the good performing pages and/or to the overall benefit of the website because of the additional content? In short, if i remove under performing pages, will it affect good performing pages and the overall performance of the website?
Keyword Research | | KrisIrr0 -
Aiming for long tails on a long piece of content, without over-optimisation and attracting Panda...
Hi, I'm currently in the process of optimising a new ecommerce site with tons of content.
Keyword Research | | azu25
We're really well-researching our information and are aiming for one page a week, so each page (such as category pages etc) is getting 5-7 days of research before the content is written, so that we know our info is correct and that more than enough content is available, rather than a simple 300-500 word article.
One category page in particular has the potential for maybe 4,000-6,000 words, or even more (I don't want to hit that, as it's not needed, but I'd like to go into enough detail about enough things to bring us up on top as the market leader) - Our biggest competitor is currently hitting around 2,500 words on the category page for their site and they're ranking for a lot of long tails. (Of course they're also getting a lot of links too!)
To put it simply, we have a better quality product and a range of options (we're one of the first [if not the first] in the UK to have several options for this product where you have the choice of going for the cheap option, or going for higher priced and better quality options etc), whereas our main competitor simply has one stand alone product. By default this gives us much more to work with regarding potential content. While building this site we haven't bothered to consider 'keyword density', as we're going for as white-a-hat as possible, but when it comes to long tails I'm finding that I may have to consider it for this page at least.
We have a few dozen long tails such as 'Where does X come from', 'Why is X so expensive', 'What is the difference between X and X' etc - You know the kind of keywords.
To help specifically with the long tails we've opted to include a FAQ section to that category page, but it seems that by doing this I have accidentally gone up to ~3% density on the 'X', which I suppose isn't too bad, but at the same time that one keyword has already made ~30 appearances in the content - and all we have done so far is the FAQ section.
I'm going through now and rewording it so that it's less 'keywordy' (although there does seem to be a limit to the number of times to can say 'it' before that starts to sound odd..), but was just wondering how you manage to write a long and detailed piece of content that is all specifically about one thing, without having to use that one keyword too many times, while also hitting plenty of long tails at the same time?0 -
Two domains, a .ca and .com, for one company
Hey we are looking for some advice on this. We have two online shopping carts, a .ca and .com for our Canadian and American customers. The information on both is obviously very similar in both content and display, with just pricing, shipping information etc. being different. Does anyone have any feedback regarding how Google would view this? The domains are the same, ie. walmart.com and walmart.ca so would Google recognize this and not penalize us for having two identical sites or would it be penalizing us and should we be going about this in a different manner? Thanks!
Keyword Research | | absoauto0 -
Looking for a recommended High Quality content creators, Recommendations?
Hi, I am looking for a recommended company which specializes in content creation to fluently create posts for our blog. This content needs to be of the highest quality. Areas of expertise - luxury goods, diamonds, diamond jewelry, fashion Any recommendations?
Keyword Research | | BeytzNet0 -
Wouldn't this be an issue of duplicate content?
I'm currently in the beginning stages of doing SEO analysis for a new client. They're an IT support company here in Phoenix, AZ. In doing some keyword research and competitive research, I've noticed that one of their competitors (who ranks in the top 3 for many of the targeted keywords), is doing something that I thought would surely be a duplicate content issue. On their home page, they have dozens of links of zip codes in the Phoenix area. Each link leads to a page devoted to that zip code. Each page is identical, except that the zip code is changed in the header tag. Most of these zip code pages are indexed in Google. Isn't this an example of duplicate content, or better yet, content spamming? I've seen this thing quite a bit with high ranking sites, and I thought these were the kinds of things that were getting taken care of in the post "Panda" era. I might just be misunderstanding this whole thing, but any guidance or intel would be greatly appreciated.
Keyword Research | | creybot0 -
Picking the next best keyword rick domain
When keyword rich domain are occupying high serp's (exact match domain choices are already gone, ie. www.widgit1widgit2.com), what would be the next best choice for SEO www.widgit1-widgit2.com or www.mywidgit1widgit2.com Peter
Keyword Research | | peterds0 -
Does google exact match domain name bonus work if the keywords are reversed?
For example, we all know that there is a ranking boost to having a domain name: http://bluewidgets.com when someone searches for "blue widgets". But would the domain name http://widgetsblue.com also get a bonus in the serp for "blue widgets" ?
Keyword Research | | adriandg0