A week ago I asked how to remove duplicate files and duplicate titles
-
Three weeks ago we had a very large number of site errors revealed by crawl diagostics. These errors related purely to the presence of both http://domain name and http://www.domain name. We used the rel canonical tag in the head of our index page to direct all to the www. preference, and we have no improvement. Matters got worse two weeks ago and I checked with Google Webmaster and found that Google had somehow lost our preference choice. A week ago I asked how to overcome this problem and received good advice about how to re-enter our preference for the www.tag with Google. This we did and it was accepted. We aso submitted a new sitemap.xml which was also acceptable to Google. Today, a week later we find that we have even more duplicate content (over 10,000 duplicate errors) showing up in the latest diagnostic crawl. Does anyone have any ideas? (Getting a bit desperate.)
-
Thanks for your reply. This seems to be what I'm looking for.
I have entered it after our 301 redirects. Hope this is best place in the .htaccess file.
Will let you know
-
Then just make sure your site map urls are all www and resubmit.
-
Okay so not bad. You just need to deal with www and non www urls.
If you have access to your htaccess file you can do it very easily with
RewriteEngine On RewriteBase / RewriteCond %{HTTP_HOST} !^www.fly-fishing-tackle.co.uk$ [NC] RewriteRule ^(.*)$ http://www.fly-fishing-tackle.co.uk/$1 [L,R=301] -
Hi,
Thanks for the response.
No CMS
Ecommerce site using Actinic which used pl files
examples:
<colgroup span="1"><col span="1" width="483"></colgroup>
http://fly-fishing-tackle.co.uk/acatalog/special_offers.html
dulpicated as:
<colgroup span="1"><col span="1" width="485"></colgroup>
| |
| http://www.fly-fishing-tackle.co.uk/acatalog/Fulling_Mill.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/fishing_nets.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/abu_garcia.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/orvis_fishing_glasses.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/giorgio_benecchi.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/snowbee_lines.html |
| http://www.fly-fishing-tackle.co.uk/acatalog/special_offers.html ||
-
Making sure I got it right..
You fixed your index/root problem with a canonical tag, then submitted a site map, now Google has found thousands of duplicate titles?
If this is correct can you give a couple examples of the types of urls that are being flagged as duplicate, and also let us know if you use any CMS (WordPress,Joomla,Oscommerce etc...)
That will help us, help you,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content Mystery
Hi Moz community! I have an ongoing duplicate mystery going on here and I'm hoping someone here can answer my question. We have an Ecommerce site that has a variety of product pages and category pages. There are Rel canonicals in place, along with parameters in GWT, and there are also URL rewrites. Here are some scenarios, maybe you can give insight as to what’s exactly going on and how to fix it. All the duplicates look to be coming from category pages specifically. For example:
Technical SEO | | Ecom-Team-Access
This link re-writes: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html?cat=407&color=152&price=20- To: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html The rel canonical tag looks like this: http://www.incipio.com/cases/tablet-cases/amazon-kindle-cases-sleeves.html" /> The CONTENT is different, but the URLs are the same. It thinks that the product category view is the same as the all products view, even though there is a canonical in there telling it which one is the original. Some of them don’t have anything to do with each other. Take a look: Link identified as duplicate: http://www.incipio.com/cases/smartphone-cases/htc-smartphone-cases/htc-windows-phone-8x-cases.html?color=27&price=20- Link this is a duplicate of: http://www.incipio.com/cases/macbook-cases/macbook-pro-13in-cases.html Any idea as to what could be happening here?0 -
Duplicate Page Content and Titles from Weebly Blog
Anyone familiar with Weebly that can offer some suggestions? I ran a crawl diagnostics on my site and have some high priority issues that appear to stem from Weebly Blog posts. There are several of them and it appears that the post is being counted as "page content" on the main blog feed and then again when it is tagged to a category. I hope this makes sense, I am new to SEO and this is really confusing. Thanks!
Technical SEO | | CRMI0 -
Magento Duplicate Content help!
How can I remove the duplicate page content in my Magento store from being read as duplicate. I added the Magento robots file that i have used on many stores and it keeps giving us errors. Also we have enabled the canonical links in magento admin I am getting 3616 errors and can't seem to get around it .. any suggestions?
Technical SEO | | adamxj20 -
Htaccess file
I need to redirect the web pages which do not exist to 404 error the task need to be done in htaccess file. I am using Linux server. the webpages I want to redirect is my domain name followed by question mark e.g. www.mydomain.com/?dfdds I am using the following snippet in my htaccess file, it redirect to bing.com so far, please tell me how to change the snippet so that it redirect to redirect to 404 error page. ========================== RewriteCond %{QUERY_STRING} . RewriteRule .* http://www.bing.com? [L,R]
Technical SEO | | semer0 -
Good Seo Titles
Hi. Mybsite is www.theprinterdepo.com and I am trying to find a good template for my product/page titles. Many users search our products by the product model: something like Q2121X. Some other users search by: hp 1320 printer or just 1320 printer. They will almost never search for hp 1320 new, or hp 1320 refurbished. My website is developed in magento, and we have a SEO plugin in which I can put a template for the URL and also a template for the product title. I was thinking for title and URL. title + condition + productmodel However many users search for: "refurbished printers" and maybe its better that our products say something like this: HP 1320 Refurbished Printer, instead of: HP 1320 Printer - Refurbished - Q2121X Please let me know your suggestions.
Technical SEO | | levalencia10 -
How do I eliminate duplicate page titles?
Almost...I repeat almost all of my duplicate page titles show up as such because the page is being seen twice in the crawl. How do I prevent this? <colgroup><col width="336"> <col width="438"></colgroup>
Technical SEO | | ENSO
| www.ensoplastics.com/ContactUs/ContactUs.html | Contact ENSO Plastics |
| ensoplastics.com/ContactUs/ContactUs.html | Contact ENSO Plastics | This is what is from the CSV...there are many more just like this. How do I cut out all of these duplicate urls?0 -
Is 100% duplicate content always duplicate?
Bit of a strange question here that would be keen on getting the opinions of others on. Let's say we have a web page which is 1000 lines line, pulling content from 5 websites (the content itself is duplicate, say rss headlines, for example). Obviously any content on it's own will be viewed by Google as being duplicate and so will suffer for it. However, given one of the ways duplicate content is considered is a page being x% the same as another page, be it your own site or someone elses. In the case of our duplicate page, while 100% of the content is duplicate, the page is no more than 20% identical to another page so would it technically be picked up as duplicate. Hope that makes sense? My reason for asking is I want to pull latest tweets, news and rss from leading sites onto a site I am developing. Obviously the site will have it's own content too but also want to pull in external.
Technical SEO | | Grumpy_Carl0 -
Duplicate Page Content and Title for product pages. Is there a way to fix it?
We we're doing pretty good with our SEO, until we added product listing pages. The errors are mostly Duplicate Page Content/Title. e.g. Title: Masterpet | New Zealand Products MasterPet Product page1 MasterPet Product page2 Because the list of products are displayed on several pages, the crawler detects that these two URLs have the same title. From 0 Errors two weeks ago, to 14k+ errors. Is this something we could fix or bother fixing? Will our SERP ranking suffer because of this? Hoping someone could shed some light on this issue. Thanks.
Technical SEO | | Peter.Huxley590