Duplicate content across domains
-
I have a client with 2 websites - one is a trucking and rigging company that specializes in installation / moving / removal of safes (site #1), the other offers a product line of safes (site #2). I originally designed / implemented site #1 and was able to get "safe installation New York", "safe moving New York", and "safe removal New York" in the top 3 search results in. A little over a year ago, client was approached by another marketing company to create the site #2, who also provided commercial services that I don't. It was a business decision, and we remained in good relations. As a result Site #1 went to the new marketing company and they built Site #2.
Fast forward to about 3 months ago - Site #1 was infected with malware, client wasn't happy with new service, and asked me to take back the Site #1 ( and remove malware), and take Site #2, and re-work the SEO. SEO had dramatically fallen off for Site #1, so I've been working the SEO once I was able to get the malware completely removed and reviewed by Google.
Site #1 had been redesigned by the other marketing company, essentially retaining the content that I created. Site #2 has mostly new content, but under "Services", it references the same services that Site #1provides, but the content is exactly the same, except that references to the company for Site #1 also link to Site #1. So there is duplicate content for 5 pages on both sites. As it happens, Site #2 that SELLS safes, is ranking #2 for "safe installation new york" for exactly the same content as Site #1 that provides the services. Site #1 ranks >50 for the same keyphrase.
Why would this be? Has Site #2 taken the lead on this keyphrase because of the malware situation and now Site #1 is being penalized for duplicate content?
One other major change on Site #1 is that the web technician used Wordpress's built in page nesting (page is set as child to parent page - nested 3 deep in some cases). What are the consequences (if there are any) of having a page listed as (for example) oztruckingandrigging.com/services/safe/safe-installation vs. oztruckingandrigging.com/safe-installation? The reason I ask this is that when I Moz page optimize for the first one for "safe installation" I get a lower grade then when I Moz page optimize for the second one.
-
I don't have direct control, but I believe there is a strong partnership (perhaps even a partial ownership) between my client and the target site. I didn't develop the safewarehouseofnewyork.com site, I have only been tasked with working the SEO. But this sounds really bad - I'm heading out the door (to the beach, it's Sunday
), and will look into this more thoroughly when I return.
I never did like the way the site designer didn't incorporate the products into the site and goes to a different site based on product line. Not the way I would do it, but maybe the client was trying to keep the cost down.
-
FYI I thought I would let you know I was going through your navigation and noticed in the product section you are making a new window or tab most of the time when clicking a link that is on the same domain.
http://safewarehouseofnewyork.com/products/superior-safe-company/ click first read more
The reason I'm bringing this up is much more important you mentioned that you were hacked.
I clicked on a URL in your product area which took me to a third-party company selling the product. What bothered me was several errors when I checked it using Sucuri.net
I found out that the site is compromised, and I would recommend if it is under your control letting the people who administer the site know ASAP you do not want to link to a hacked site.
https://sitecheck.sucuri.net/results/www.ftknox.com/store/
If your site was hacked and you are linking directly to these other sites inside your products area, I would not divert people from my site unless I had an excellent reason.
If these are under your umbrella you will want to fix this ASAP
You can check for malware and get sites fixed very easily using https://sitecheck.sucuri.net/
- PHP error: Fatal error: Call to protected pluginSedLex::__construct() fro
Fatal error: Call to protected pluginSedLex::__construct() from invalid context in /nfs/c03/h03/mnt/52872/domains/ftknox.com/html/wp-content/themes/fortknox/sidebar.php on line 44
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/store/ ( View Payload ) |
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/vaults/the-maverick-vault/ ( View Payload ) |
| Website Malware | php-error-fatal-error?v6 | http://www.ftknox.com/store/ ( View Payload ) |<code>**Site error detected. Details: http://sucuri.net/malware/php-error-fatal-error?v6** **Fatal error**: Call to protected pluginSedLex::__construct() from invalid context in **/nfs/c03/h03/mnt/52872/domains/ftknox.com/html/wp-content/themes/fortknox/sidebar.php** on line **44**</code>
-
There is a saying in SEO cool links do not change. If you are creating new links ideally, in my opinion, the shorter the URL the better. As long as it is of course descriptive
"I am not having a problem with the "function" of the site. My question relates to best practices for SEO - would it be better to have the URL be simply oztruckingandrigging.com/safe-installation or is it basically equivalent to have the URL be as it is, oztruckingandrigging.com/our-services/safes/safe-installation/."
I would recommend a URL like a number one over number two
- http://oztruckingandrigging.com/safe-installation (for usability this is much better considering the length of your domain as well)
- http://oztruckingandrigging.com/our-services/safes/safe-installation ( you have the same word twice in this URL not good)
See
- https://moz.com/blog/15-seo-best-practices-for-structuring-urls
- https://www.woorank.com/en/blog/url-optimization-5-best-practices-for-seo
**Duplicate content is addressed here in an extremely thorough manner. **
-
http://www.hobo-web.co.uk/duplicate-content-problems/ (This is the most relevant and thorough)
imagine what Google does to sites that reuse content and imagine if it's a different domain only one will be indexed ( most of the time) a great explanation is in this video. This might not feel like it is relevant to multiple domains but it is because all of it's in Google's index already.
https://youtu.be/nMrYeUWlslY?t=5m41s
Using duplicate content across domains, I do not suggest using because of what I stated above that the site would more authority will take all credit for the content.
I hope this helps,
Tom
-
There is no official duplicate content penalty from Google. If that is what you are asking? Now it's two sites have identical conte there is no official duplicate content penalty from Google. If that is what you are asking? Now if two sites have identical content and Google Will give the domain with a higher authority the higher ranking for the exact same term. But this would mean that are identical in terms of every single manner except for Domain Athorthy the rights to the content only become googles concern when you file a digital millennium take down act. Or DMCA you would not do this in your situation you would only do this in a situation where somebody else is useing your content.
So when Google chooses the flight that gets the authority for the content they will choose one of the two sites or one of however many sites have not content on the index after which the sites with the identical content will not ran so when Google chooses the site that gets the authority for the content they will choose one of the two sites or one of however many sites have not content on their index after which the sites with the identical Content will not benefit from the content that is already indexed and ranking on a higher authority domain.
There are exceptions for every rule every site is unique Google needs to decipher which thinks is the best for the end-user remember Google is in business as a search engine for end-users not for us SEO , Devs, or site owners. The amount of factors that goes into the decision is so much higher than what I want to get into right now but if somebody has a higher rate has people with more time on site has proven that their site present a better user experience actually help make websites for
Google likes unique high quality fresh content and can figure out what is best for users there's a huge difference between a penalty and serving the ideal page to the end user. So while theoretically it is possible to rank #1 using identical content it is not something I would recommend.
I can see that you're hosting with Wiretree I am in a supermarket on my telephone right now so I will lose my mind when I am not in front of my computer however I just wanted to update you on Content and please excuse any spelling or grammar glitches.
Tom
-
My apologies - I should have referenced "our-services" instead of "services", no minor detail.
- Are you using a particular WordPress hosting company?
I host the sites on my dedicated server and provide wordpress maintenance - Do you have a specific plug-in that you're using to create redirects?
I do, but I did not redirect these URLs - Do you create redirects by using either PHP, Apache, Nginx or Varnish?
I use a redirect plugin - but good point, it's possible that the previous developer added 301 redirects in .htaccess. I believe, though, that this is done by native Wordpress based upon the relationship between the primary domain, and the parent pages. - How familiar are you with your database?
Familiar enough to find issues in it via phpadmin. Again this is a Wordpress site, and it's not a frequent requirement that I modify the database directly - Did you do a search and replace when you moved or migrated the site?
The structure, domain and navigational URLs of the site did not change. I received a zip file of the database from the previous site manager, and I FTPd the files from the original location.
***ACTUAL QUESTION: I am not having a problem with the "function" of the site. My question relates to best practices for SEO - would it be better to have the URL be simply oztruckingandrigging.com/safe-installation or is it basically equivalent to have the URL be as it is, oztruckingandrigging.com/our-services/safes/safe-installation/ ***
Again, the site works the way it is supposed to - I do see a few 404s unrelated to this question that I need to clean up, and I very much appreciate the additional resources you have provided me. You put together a very thorough answer, but I think it wasn't clear the question I was actually asking. I do already have the free version of Screaming Frog, but I am unfamiliar with the others.
I still am not sure of the answer for the initial question regarding duplicate page content across two different sites and whether there is a penalty.
Thank you!
- Are you using a particular WordPress hosting company?
-
Ok, You are using child and parent pages? That is what is causing the /safe/safe/ you are redirecting to a forward slash "/" but they're not duplicates because their 301 redirects they're not just forwarding there actually Telling Google this is no longer the URL is the new one.
I would have to see what you're using to create redirects it most likely is a regex or plug-in setting.
- Are you using a particular WordPress hosting company?
- Do you have a specific plug-in that you're using to create redirects?
- Do you create redirects by using either PHP, Apache, Nginx or Varnish?
- How familiar are you with your database?
- Did you do a search and replace when you moved or migrated the site?
According to
http://www.redirect-checker.org/index.php
http://oztruckingandrigging.com/safes/safe-installation
301 Moved Permanently
http://oztruckingandrigging.com/our-services/safes/safe-installation/
200 OKHTTP Headers
301 Moved Permanently
| Status: | 301 Moved Permanently |
| Code: | 301 |
| Date: | Fri, 22 Jul 2016 14:57:59 GMT |
| Server: | Apache |
| P3P: | CP="NOI" |
| Expires: | Wed, 11 Jan 1984 05:00:00 GMT |
| Cache-Control: | no-cache, must-revalidate, max-age=0 |
| Pragma: | no-cache |
| Set-Cookie: | PHPSESSID=b1ebec8c1eb3d19a6731cdab6f3187e7; path=/ |
| Location: | http://oztruckingandrigging.com/our-services/safes/safe-installation/ |
| Vary: | Accept-Encoding |
| Content-Length: | 0 |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |http://oztruckingandrigging.com/our-services/safes/safe-installation/
200 OK
| Status: | 200 OK |
| Code: | 200 |
| Date: | Fri, 22 Jul 2016 14:58:00 GMT |
| Server: | Apache |
| Accept-Ranges: | bytes |
| Content-Length: | 76093 |
| Vary: | Accept-Encoding |
| Cache-Control: | max-age=0, public |
| Expires: | Fri, 22 Jul 2016 14:58:00 GMT |
| X-Powered-By: | WP Rocket/2.8.5 |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |http://oztruckingandrigging.com/safes/safe-installation
redirects to
http://oztruckingandrigging.com/our-services/safes/safe-installation/ (forward /)
not
http://oztruckingandrigging.com/services/safes/safe-installation (no "/" it a 404)
404 Not Found
HTTP Headers
http://oztruckingandrigging.com/services/safes/safe-installation
404 Not Found
| Status: | 404 Not Found |
| Code: | 404 |
| Date: | Fri, 22 Jul 2016 15:00:06 GMT |
| Server: | Apache |
| P3P: | CP="NOI" |
| Expires: | Wed, 11 Jan 1984 05:00:00 GMT |
| Cache-Control: | no-cache, must-revalidate, max-age=0 |
| Pragma: | no-cache |
| Link: | <http: oztruckingandrigging.com="" wp-json="">; rel="https://api.w.org/"</http:> |
| Set-Cookie: | PHPSESSID=3a1bd33b57cabd2fb804d5c5cc42365b; path=/ |
| Vary: | Accept-Encoding |
| Connection: | close |
| Content-Type: | text/html; charset=UTF-8 |it 404's http://d.pr/i/19KcJ
http://oztruckingandrigging.com/safe-installation
301 Moved Permanently
http://oztruckingandrigging.com/safe-installation-news/ ( note the forward slash "/" on all these)
200 OK>>> http://oztruckingandrigging.com/safe-installation
"The site wasn't rebuilt completely, they changed themes (appearance) only, the page management structure (see page manager description above) - the content and general navigational structure remains the same. It just looks different, which should make no difference to Google."
Changing the theme can modify a lot of code. Go into Google Webmaster tools or search console
Here https://www.google.com/webmasters/tools/home?hl=en
Then go to crawl errors and look for 404's obviously there are going to be some 404's when modifying themes because even if all your URLs stay the same way all your URIs will not. Either way, all your URLs will not stay the same way, and you change the theme.
After which I would strongly recommend using two toolsets right now you can use https://deepcrawl.com for free it will show you everything wrong with your site. Via https://app.deepcrawl.com
Another tool I would use that is extremely helpful is
https://www.screamingfrog.co.uk/seo-spider/ there is a free and paid version for right now try the free and I think you'll be happy with the results. Obviously, 99 UK a year is not much to pay.
http://www.siteliner.com/ is designed to show you duplicate content on page and redirects it is excellent at sniffing out duplicate content I would use all three tools.
"Why would Moz Page Optimization see these two pages differently? "
Because there are multiple words in the URL that make them different. Also, there may be some settings that are slightly different in your on the page I have not looked.
the safe installation page ( the links do not go live in less you make them you links.)
Rel="canonical"
http://safewarehouseofnewyork.com/services/safe-installation/ -
I have no crawl errors / no 404s - and the nesting I refer to looks like this on the page manager dashboard in WordPress:
Services
-Safes (page parent is Services)
--Safe Installation (page parent is Safes)So Services is a page, Safes is a page, and Safe Installation is a page. You can get to oztruckingandrigging.com/services/safes/safe-installation by going to oztruckingandrigging.com/safes/safe-installation, as well as oztruckingandrigging.com/safe-installation. I find it odd that the Page Optimization score is 92% for the first, but 96% for the last? Why would Moz Page Optimization see these two pages differently? All their Services are layed out the same way (i.e. safe moving, safe removal, safe storage have "Safes" as a parent and , of course, "Services" as the Safes parent.
And the site wasn't rebuilt completely, they changed themes (appearance) only, the page management structure (see page manager description above) - the content and general navigational structure remains the same. It just looks different, which should make no difference to Google.
I still am trying to wrap my head around the fact that Safewarehouseofnewyork.com's safe installation page is #2 for Safe Installation New York (behind homeadvisor.com 5 best safe installers in New York), whereas oztruckingandrigging.com's safe installation page (which has exactly the same content) ranks >51.
I am considering changing the safe warehouse site to have a landing page for Services with references and links to each safe service that they partner with OZ trucking on. Thoughts? I hate losing that #2 ranking, though.
-
There is no real Google penalty for content duplication. Unless you're talking about stealing content which then digital millennium takedown acts
http://www.copyright.gov/legislation/dmca.pdf
It does not sound like you are talking about stealing content.
"Site #1 had been redesigned by the other marketing company, essentially retaining the content that I created. Site #2 has mostly new content, but under "Services", it references the same services that Site #1provides, but the content is exactly the same, except that references to the company for Site #1 also link to Site #1. So there is duplicate content for 5 pages on both sites. As it happens, Site #2 that SELLS safes, is ranking #2 for "safe installation new york" for exactly the same content as Site #1 that provides the services. Site #1 ranks >50 for the same keyphrase."
How can they rank identically for the same key phrases? It would make sense that a site being rebuilt completely would lose a tremendous amount of traffic in some cases.
- https://www.deepcrawl.com/knowledge/tag/migration/
- https://moz.com/blog/how-to-avoid-an-seo-disaster-when-changing-your-website
- https://moz.com/blog/web-site-migration-guide-tips-for-seos
- to fix
- https://www.screamingfrog.co.uk/seo-spider/
- https://www.deepcrawl.com
Look in Webmaster tools for 404's look for issues with your site structure and try to find out as much as you can from the other company about the way it was built. It sounds like you're talking about nesting giving you a 404 is this correct?
I would make sure that the content is only on one of the sites and not being utilized on both of them as it does not help to have duplicate content. Please understand what I said about penalties and best practices are very different.
Respectfully,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How much does Domain Authority effect the keywords I can rank for?
I've been doing some keyword research and i've found a few gems. My site is currently sat at a 18 domain authority up from 12, so it's great to see the improvement. Although I was wondering, if my domain authority is sat a 18, can I compete with keywords that have a difficulty of 50-60? Any help would be greatly appreciated 🙂 Sam
Keyword Research | | sammecooper1 -
Does anyone know of a good keyword identification tool to be used on a particular piece of content?
I'm hoping for a tool that would extract keyword possibilities from an article, run them through a keyword popularity tool such as Google AdWords Keyword Planner and present ranked results (including number of monthly searches) to the writer. That would enable the writer to choose relevant popular keywords (especially phrases) in the web headline, page title and text. Does anyone know of such a tool? I'm considering having one built in-house if nothing already exists. How it might work Ideally, this might be a browser add-on. The user would highlight the story or blog text, and click on the browser add-on button to start the tool. Using something like viewer.opencalais, the text would plug into a keyword extraction tool and automatically run the results. In the next step the extracted terms would automatically plug into the Google AdWords Keyword Planner and run the results for “Keyword Ideas.” I think this can be done via the AdWords API: https://developers.google.com/adwords/api/docs/reference/v201402/TrafficEstimatorService?hl=fr The user would then be presented with a series of ranked keyword possibilities based on relevance and popularity. Why it’s useful This would make it far more efficient for busy journalists (or anyone) to write effective web headlines.
Keyword Research | | TampaBayTimes0 -
Content creation
I don't mind putting in the work to do it I just want it to be worth it. How do i find the best content to write about I do lawn care yeah super exciting I know, but there has to be a way I can find out what people are searching for and create the content before they search. So my question is how do you find out what content will go viral im not saying like spin out and land on CNN but I mean there's got to be a way I can figure this out. Anything would be helpful. Thanks guys and girls.
Keyword Research | | gslc0 -
Wouldn't this be an issue of duplicate content?
I'm currently in the beginning stages of doing SEO analysis for a new client. They're an IT support company here in Phoenix, AZ. In doing some keyword research and competitive research, I've noticed that one of their competitors (who ranks in the top 3 for many of the targeted keywords), is doing something that I thought would surely be a duplicate content issue. On their home page, they have dozens of links of zip codes in the Phoenix area. Each link leads to a page devoted to that zip code. Each page is identical, except that the zip code is changed in the header tag. Most of these zip code pages are indexed in Google. Isn't this an example of duplicate content, or better yet, content spamming? I've seen this thing quite a bit with high ranking sites, and I thought these were the kinds of things that were getting taken care of in the post "Panda" era. I might just be misunderstanding this whole thing, but any guidance or intel would be greatly appreciated.
Keyword Research | | creybot0 -
Is 15 keywords enough to properly optimize content for an entire domain?
I have recently moved in charge of a 95 page web portal that has around 8 categories of content. The SEO agency I am touch with has sent me a proposal that says they will do on-page optimization for this domain for 15 keywords. Should that be enough? What should be my expected outcome? My promise to the client is that core pages from his website will show up early on the SERPs. If they can do this, I am fine with it. Do you think I am getting the right deal? Should I be asking for more?
Keyword Research | | amit20760 -
How to proceed after accidentally misspelling a domain name
Hi guys, I was looking to create a nice microsite and was using the Keyword Analysis tool to help find some good ideas. The problem is that I didn't know how to spell the item I was curious about. When I typed in the wrong spelling, it gave a pretty good result, so I went ahead and bought the domain and started thinking about content. Now I have a domain with a bad name. The correct spelling domain is ranked through the ozone and there's no chance I can compete with those guys. What do I do? Give up on the domain? I'm thinking to go ahead and continue outlining my site as if the domain had the correct spelling all along. But I confused over whether the home page should rank for the correct or incorrect spelling. Any help would be great.
Keyword Research | | DanielBMarkham0 -
How do you order similar keywords when writing content?
Let's say I sell widgets: plastic widgets, paper widgets, brass widgets and steel widgets. These are in order by how popular they are but none is so popular to really stand on it's own. When writing general content about widgets, lets say for the main Widgets page, would you write: 1. "We sell plastic, paper, brass and steel widgets." -or- 2. "We sell plastic widgets, paper widgets, brass widgets and steel widgets." I understand I can have specific pages for Plastic Widgets, Paper Widgets, etc., but like I said this would be for a main category page, maybe even for a quick "this is what we do" opening paragraph on the homepage. Is it better to be concise like in example 1? Or to individually call out each type like in example 2? I'm looking for SEO insight and the customer experience viewpoint as well.
Keyword Research | | rball10 -
Duplicated string in the google keyword tool
Is it possible that the google keyword tool is wrong? It's the first time I realize that for many keywords the google keyword tool reports a big volume of searchs for a keyword as if it were tiped two times. In some cases, as the attached image, it's the same volume, in other cases is even bigger the one with the duplicated string What should I think of that, that, "champagne champagne" has really 4 million searchs? if champagnechampagne.com were an available domain name, should it be a good idea for a microsite? Thank you! t9Jwn.png
Keyword Research | | gvnns0