Why is Coyscape showing content duplication error even after implementing 301 redirect ?
-
We are maintaining the corporate website of one of our prestigious clients "FineTech Toolings" (http://www.finetechtoolings.in). Recently I had raised a question regarding "2 websites running paralley in 2 diferent domains, i.e. 1 organisation having 2 different websites on 2 different domains". Recently my domain changed from http://www.finetechtoolings.co.in to http://www.finetechtoolings.in via 301 redirect, but still I am facing content duplication issue as per Copyscape. Hence I am having a small doubt regarding the same. Please note the following question very carefully and provide me the exact problem and the solution for the same:
Even though I have implemented 301 redirect (http://www.finetechtoolings.co.in is redirected to http://www.finetechtoolings.in), which is completely ok as per the SEO rules, why is copyscape still showing that duplicate content exists in the former website?
I think I am clear enough with my question.
-
Was the change to the 301 redirects made and copyscape still provided that error?
-
okay you are still dealing with 302 redirects because you are using a old Windows server . & non Windows server move the redirects to the new server
copying paste the URL http://www.finetechtoolings.co.in/featured-products below into the tool below
http://www.ragepank.com/redirect-check/
I know you're running Windows because of this your header
http://www.feedthebot.com/tools/headers/test.php
I tried this tool as well
http://99webtools.com/url_redirect_checker.php#
I know you are using Joomla! and I do not know what you are using before so I would redirect page to page for the entire site.
http://www.webconfs.com/how-to-redirect-a-webpage.php
http://99webtools.com/blog/htaccess-redirect-entire-site-to-new-domain/
or if your host Is managed or has 301's
https://kb.mediatemple.net/questions/1889/How+do+I+use+the+Redirect+Domains+tool%3F
your new server may not be the best setup either.
http://sitecheck.sucuri.net/results/www.finetechtoolings.in
https://www.virustotal.com/en/ip-address/204.11.58.237/information/
In Apache .htaccess - not Windows, Cold Fusion etc
It is normal practice to have domains linked and accessed via the www version. However, if you prefer the non www version, just reverse the following:
To redirect all traffic from http://finetechtoolings.co.in to http://www.finetechtoolings.co.in (and also redirect all other domains parked into the same webspace)
RewriteEngine on
RewriteCond %{HTTP_HOST} !^www.finetechtoolings.co.in
RewriteRule (.*) http://www.finetechtoolings.co.in/$1 [R=301,L]To redirect http://www.finetechtoolings.co.in/index.html tohttp://www.finetechtoolings.co.in. Change to .htm or .shtml depending on your requirementsand http://www.finetechtoolings.co.in/index.php tohttp://www.finetechtoolings.co.in
RewriteEngine on
Options +FollowSymLinks
RewriteCond %{THE_REQUEST} ^./index.html
RewriteRule ^(.)index.html$ http://www.finetechtoolings.co.in/$1 [R=301,L] RewriteCond %{THE_REQUEST} ^./index.php
RewriteRule ^(.)index.php$ http://www.finetechtoolings.co.in/$1 [R=301,L]HTTP/1.1 301 Moved Permanently
Cache-Control: max-age=900
Content-Length: 0
Content-Type: text/html
Location: http://www.finetechtoolings.in/featured-products
Server: Microsoft-IIS/7.5
X-AspNet-Version: 4.0.30319
X-Powered-By: ASP.NET
Date: Fri, 13 Feb 2015 07:16:39 GMT
Age: 1
Connection: keep-alive
302 Found
| Status: | 302 Found |
| Code: | 302 |
| Connection: | close |
| Pragma: | no-cache |
| cache-control: | no-cache |
| Location: | /featured-products |/featured-products
301 Moved Permanently
| Status: | 301 Moved Permanently |
| Code: | 301 |
| Cache-Control: | max-age=900 |
| Content-Type: | text/html |
| Location: | http://www.finetechtoolings.in/featured-products |
| Server: | Microsoft-IIS/7.5 |
| X-AspNet-Version: | 4.0.30319 |
| X-Powered-By: | ASP.NET |
| Date: | Fri, 13 Feb 2015 07:07:41 GMT |
| Content-Length: | 0 |
| Age: | 1 |
200 OK
| Status: | 200 OK |
| Code: | 200 |
| Date: | Fri, 13 Feb 2015 07:07:42 GMT |
| Server: | Apache Phusion_Passenger/4.0.10 mod_bwlimited/1.4 mod_fcgid/2.3.9 |
| X-Powered-By: | PHP/5.4.24 |
| P3P: | CP="NOI ADM DEV PSAi COM NAV OUR OTRo STP IND DEM" |
| Expires: | Mon, 1 Jan 2001 00:00:00 GMT |
| Cache-Control: | no-store, no-cache, must-revalidate, post-check=0, pre-check=0 |
| Pragma: | no-cache |
| Set-Cookie: | 989a6c68136428d6a0309e254f8f03c5=da24d5038d56df52ad2d27f409e59217; path=/; HttpOnly |
| Last-Modified: | Fri, 13 Feb 2015 07:07:42 GMT |
| Connection: | close |
| Content-Type: | text/html; charset=utf-8 |SEO friendly way
Another way to redirect is page by page. Following rule redirects each page on old domain to same page on new domain (eg: http://olddomain.com/page.html to http://newdomain.com/page.html).
This is the best way also recommended by Google
| 12 |
RewriteEngine on``RewriteRule ^(.*)$ http://newdomain.com/$1 [R=301,L]
| -
Hi Thomas Zickell,
I would like to thank you for taking your valuable time to provide your insightful response.
Basis the points that you have mentioned, I just want to let you know that I haven't implemented the 301 redirect through '.htaccess' file, but I have done the same from the backend of the domain www.finetechtoolings.co.in (in my case it's Godaddy) and then I have changed my entire domain i.e. http://www.finetechtoolings.co.in to http://www.finetechtoolings.in in the hosting space.
I believe from the backend once the 301 redirect is implemented to the domain itself, it would also get applied for all the inside pages of the website. Right? Will that be enough or do I have to manually set the 301 redirect rule from the '.htaccess' file as well? Please help me clear my doubt.
Thanks in advance.
-
Google will have to index your entire site and update their side of it.
So all of the URLs in your website will have to be indexed and updated.
there is nothing wrong with copy scape if you go to Google and type in site:finetechtoolings.co.in You will see in Google's index cached there are two PDFs on the www. along with 22 other URLs still in Google's index
you will see 22 indexed pages this is not the end of the world Google simply has to catch-up to your 301. Did you 301 redirect every page?
I hope this helps,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
404 Errors for Form Generated Pages - No index, no follow or 301 redirect
Hi there I wonder if someone can help me out and provide the best solution for a problem with form generated pages. I have blocked the search results pages from being indexed by using the 'no index' tag, and I wondered if I should take this approach for the following pages. I have seen a huge increase in 404 errors since the new site structure and forms being filled in. This is because every time a form is filled in, this generates a new page, which only Google Search Console is reporting as a 404. Whilst some 404's can be explained and resolved, I wondered what is best to prevent Google from crawling these pages, like this: mydomain.com/webapp/wcs/stores/servlet/TopCategoriesDisplay?langId=-1&storeId=90&catalogId=1008&homePage=Y Implement 301 redirect using rules, which will mean that all these pages will redirect to the homepage. Whilst in theory this will protect any linked to pages, it does not resolve this issue of why GSC is recording as 404's in the first place. Also could come across to Google as 100,000+ redirected links, which might look spammy. Place No index tag on these pages too, so they will not get picked up, in the same way the search result pages are not being indexed. Block in robots - this will prevent any 'result' pages being crawled, which will improve the crawl time currently being taken up. However, I'm not entirely sure if the block will be possible? I would need to block anything after the domain/webapp/wcs/stores/servlet/TopCategoriesDisplay?. Hopefully this is possible? The no index tag will take time to set up, as needs to be scheduled in with development team, but the robots.txt will be an quicker fix as this can be done in GSC. I really appreciate any feedback on this one. Many thanks
Technical SEO | | Ric_McHale0 -
301 Redirect Expert
I have hired two website people from odesk and had bad experience in 301 redirects. One never got it done and the other cause my website to crash on a 500 error code, he load all the redirects in a script on .htaccess on my wordpress site on godaddy, there were 1400 redirect.Can somebody recommend a expert for my redirect problem.
Technical SEO | | tjacquet0 -
404 to 301 redirects is there a limit?
Hi We've just updated our website and have binned out alot of old thin content which has no value even if re written. We have a lot of 404 error on WMT and I am in the process of doing 301 redirects on them. Is there a limit to the number of 301 the site should have?
Technical SEO | | Cocoonfxmedia0 -
To avoid errors in our Moz crawl, we removed subdomains from our host. (First we tried 301 redirects, also listed as errors.) Now we have backlinks all over the web that are broken. How bad is this, from a pagerank standpoint?
Our MOZ crawl kept telling us we had duplicate page content even though our subdomains were redirected to our main site. (Pages from Wineracks.vigilantinc.com were 301 redirected to vigilantinc.com/wineracks.) Now, to solve that problem, we have removed the wineracks.vigilantinc.com subdomain. The error report is better, but now we have broken backlinks - thousands of them. Is this hurting us worse than the duplicate content problem?
Technical SEO | | KristyFord0 -
Duplicate page content
Hello, The pro dashboard crawler bot thing that you get here reports the mydomain.com and mydomain.com/index.htm as duplicate pages. Is this a problem? If so how do I fix it? Thanks Ian
Technical SEO | | jwdl0 -
Error msg 'Duplicate Page Content', how to fix?
Hey guys, I'm new to SEO and have the following error msg 'Duplicate Page Content'. Of course I know what it means, but my question is how do you delete the old pages that has duplicate content? I use to run my website through Joomla! but have since moved to Shopify. I see that the duplicated site content is still from the old Joomla! site and I would like to learn how to delete this content (or best practice in this situation). Any advice would be very helpful! Cheers, Peter
Technical SEO | | pjuszczynski0 -
301 Redirect Help
Hello! I am getting ready to launch my freshly coded site in the next week or so. My product URLs are changing SLIGHTLY and want to confirm I am going about things the right way: A. My LIVE site store URLs look like http://hiphound.com/shop/dog-collars . My DEV site store URLs look like http://hiphound.com/dog-collars . No /shop directory. B. The dev firm installed the rewrite rule below: ############################################ enable rewrites Options +FollowSymLinks RewriteEngine on #RedirectMatch 301 ^/shop?/$ http://hiphound.com/ RedirectMatch 301 ^/shop?/$ http://hiphound.com ########################################### C. When I manually enter a URL with /shop in the address the website redirects to the correct page which is good. QUESTIONS I HAVE 1. Is the above redirect correct? I need them to permanent. Don't think the above is right... 2. Will links in the Google index be redirected as well? I am assuming yes but just want to confirm. 3. For each page indexed in Google will its pagerank, etc. be passed to the new page using just the 301 above? 4. Do I need to create addtional 301s for each page? So mapping the old page to the new page? Please advise. The goal here is to of course preserve the rankings of the pages already in the Google index. THANK YOU!!! Lynn
Technical SEO | | hiphound0 -
301 redirect on the root of the site
Due to some historic difficulties with our URL Rewriter, we are in the position of having the root of our site 301 redirected to another page. So the root of our site: http://www.propertylive.co.uk/ has a 301 redirect to: http://www.propertylive.co.uk/home.aspx We're aware that this isn't great and we're working to fix this completely, but what impact will this have on our SEO?
Technical SEO | | LianWard860