Duplicate Page Titles and Duplicate Content
-
I've been a Pro Member for nearly a year and I am bound and determined to finally clean up all the crawl errors on our site PracticeRange.com.
We have 180 errors for Duplicate Page Titles and Duplicate Content. I fixed many of the pages that were product pages with duplicate content. Those product descriptions were edited and now have unique content.
However, there remain plenty of the errors that are puzzling. Many of the errors reference the same pages, for example, the Home Page, Login Page and the Search page (our catalog pages).
In the case of the Catalog Page errors, these type pages would have the same title every time "Search" and the results differ according to category.http://www.practicerange.com/Search.aspx?m=6
http://www.practicerange.com/Search.aspx?m=15If this is rel=canonical issue, how do I fix it on a search result page? I want each of the different category type pages to be indexed. One of them is no more important than the other. So how would I incorporate the rel=canonical?
In the case of the Home Page errors, I'm really confused. I don't know where to start to fix these. They are the result of a 404 error that leads to the home page. Is the content of the 404 page the culprit since it contains a link to the home page?
Here are examples of the Home Page type of crawl errors.
Thanks ,
-
Thanks Dan,
I appended the asterisk. I also tested the robots.txt in google webmaster tools. It alerted me of the required : colon after the disallow statement. I missed that somehow.
The next crawl should finally ignore those search catalog pages.
Best Regards,
Alan
-
Hi Alan,
It seems like you are only targeting the search page, I would suggest adding a * at the end to capture all variations.
Dan
-
Hi Dan,
Latest SEOMOZ crawl still reports 108 Duplicate Page Titles. Almost all of them are from the Search page.
Search
http://www.practicerange.com/search.aspx?s=Name ASC&p=5
Search
http://www.practicerange.com/search.aspx?s=Name ASC&p=50
Search
http://www.practicerange.com/search.aspx?s=Name ASC&p=51
Search
http://www.practicerange.com/search.aspx?s=Name ASC&p=52
etc.....
I added Disallow http://www.practicerange.com/Search.aspx but it still picked it up during the crawl. Here is the robots.txt.
User-Agent: *
Disallow: /Admin/
Disallow: /App_Themes/
Disallow: /Assets/
Disallow: /Checkout/
Disallow: /ClientApi/
Disallow: /ConLib/
Disallow: /FCKeditor/
Disallow: /images/
Disallow: /Install/
Disallow: /Layouts/
Disallow: /Members/
Disallow: /webcharts/
Disallow: /Basket.aspx
Disallow: /BuyProduct.ashx
Disallow: /*.axd$
Disallow http://www.practicerange.com/Search.aspxSitemap: <http: www.practicerange.com="" sitemap.xml="">Sitemap: http://www.practicerange.com/sitemap.xml</http:>
Am I missing something on the syntax to get the crawl to ignore our Search Pages?
Best Regards,
Alan
| | | | |
| | | | |
| | | | |
| | | | |
| | | | |
| | -
Hi Alan,
Have a look in google webmasters to see if the same 404's are occuring there. If so, they typically give you a list of page that generate the error page. It would be best to eliminate these issues at the source first as they will be offering a poor user experience.
As a prevented measure you could run these pages as a disallow, yes. But I fear that this will make it more difficult to detect these issues in future.
Dan
-
Thanks Dan,
Got it. The catalog pages are not beneficial and the duplication could be hurting.
So I added the disallow statement for the Search pages. We will see if it fixes the problem on our next crawl and change syntax as needed.
Would a similar disallow for the 404.aspx would solve the Home Page 404 crawl errors? Something like...
Disallow http://www.practicerange.com/404.aspx?*
Best Regards,
Alan Wills
-
Hi Alan,
This is a two part question. For the search results I would add
Disallow http://www.practicerange.com/Search.aspx?m=*
To your robots.txt file. I would probably increase to the entirety of search (by removing the ?m= from the line above), but as I don't completely comprehend how your search section works start with the above. It very rare that search pages offer new content, generally they dilute other pages by duplication.
With your second issue I imagine there are clues in the aspxerrorpath variable. Although I couldn't get any combination of this string to render the below url didn't return to the 404 page like the rest did. Its the tilda (~) in the error string that I think offers the biggest clue.
http://www.practicerange.com/Golf-Training-Aids/Golf-Nets/
Hope this helps,
Dan
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to fix duplicate content for homepage and index.html
Hello, I know this probably gets asked quite a lot but I haven't found a recent post about this in 2018 on Moz Q&A, so I thought I would check in and see what the best route/solution for this issue might be. I'm always really worried about making any (potentially bad/wrong) changes to the site, as it's my livelihood, so I'm hoping someone can point me in the right direction. Moz, SEMRush and several other SEO tools are all reporting that I have duplicate content for my homepage and index.html (same identical page). According to Moz, my homepage (without index.html) has PA 29 and index.html has PA 15. They are both showing Status 200. I read that you can either do a 301 redirect or add rel=canonical I currently have a 301 setup for my http to https page and don't have any rel=canonical added to the site/page. What is the best and safest way to get rid of duplicate content and merge the my non index and index.html homepages together these days? I read that both 301 and canonical pass on link juice but I don't know what the best route for me is given what I said above. Thank you for reading, any input is greatly appreciated!
On-Page Optimization | | dreservices0 -
Duplicate Titles - Recruitment Agency
Hi All, I was just wondering if anyone had come across this problem before - We are a recruitment agency so we have multiple of the same jobs at the same time, so we're looking into ways to differentiate and change it but we've got the same Duplicate Titles - has anyone faced this problem before? And if so what did they do? Thanks in advance!
On-Page Optimization | | marketingmc0 -
Does hreflang restrain my site from being penalized for duplicated content?
I am curently setting up a travel agency website. This site is going to be targeting both american and mexican costumers. I will be working with an /es subdirectory. Would hreflang, besides showing the matching language version in the SERP´s, restrain my site translated content (wich is pretty much the same) from being penalized fro duplicated content? Do I have to implement relcannonical? Thank ypu in advanced for any help you can provide.
On-Page Optimization | | kpi3600 -
How to remove duplicate content issues for thin page(containing oops no resulting found)
In this scenarios we have multiple different URLs but the page content is rendering same (containing Oops message) due to which content duplicate's issue arises.As soon as content for these URL,s are available then those pages duplicate issue will removed. So we want to remove duplicate issue not the page & Page URLs.
On-Page Optimization | | surabhi60 -
Product Attribute pages and Duplicate content
Hiya I have two queries is about a jewellery shop running on wordpress and woocommerce. 1. I am a little indecisive on how to index the product categories without creating duplicate pages which will get me into trouble. For example: All earrings are listed on the category page: chainsofgold.co.uk/buy/earrings/ We also have product attribute pages which lists all the subcategories for the earrings: chainsofgold.co.uk/earrings/creoles/
On-Page Optimization | | bongoheads
chainsofgold.co.uk/earrings/drop/
chainsofgold.co.uk/earrings/studs/ I have the category URL and the product attribute URLs set to be indexed on my sitemaps. Will this get me into trouble creating duplicate content with the main category page? Should I only have the main category indexed and "no-index, follow" all the product attribute pages? 2. I am also thinking about incorporating these product attribute URLS into my menu so when people hover over earrings they get shown the types of earrings they can buy. However, I have the woocommerce faceted navigation working on the category pages. So if someone is visiting the page chainsofgold.co.uk/buy/earrings/ The user can click on the left hand side, and select "drops". The URL they will get though is one which is not indexed: http://www.chainsofgold.co.uk/buy/earrings/?filter_earrings=123 Can I link to those product attribute pages without the risk of getting accused of creating duplicate content? Thank you for your help. Carolina0 -
E-commerce store having same content different language pages
Hello, I have an e-commerce store operating on PrestaShop. I have four languages Fr, De, En and Nl. The url for each page changes like Example.com/en/product1 Example.com/fr/Product1 Example.com/de/product1 Example.com/nl/Product1 All these pages have same content about product1 but translated in respective language. Is it considered as duplicate content? Should I suppose to write different content for each page?
On-Page Optimization | | MozAddict0 -
Why Does Google Keep Changing My Page Titles?
I know Google has been doing this for quite some time but how do you "control" what Google will display as your page name? Lots of my pages come up with a title like "[searched keyword] - [website name]" in the search results. I usually a huge drop in CTR when this happens. On the other hand, there are some pages which have kept their title intact in the search results. So what gives? How come one page's title is changed and the other is not?
On-Page Optimization | | sbrault740 -
Dupelicate content home page and custom page question
I am working on a website that got hit by the penguin update. Didn't get hit terribly bad, but dropped from number one to number 9. As I'm going through the pages, the theme and content is a mess. To give an example, say the site is about custom colored marbles. The main page content covers custom colored marbles, custom promotional marbles, custom glass marbles, etc. Custom colored marbles is mentioned and covered on all pages, which I am going back and trying to make each page theme specific. There is also a custom page, so I am at a cross roads on how best to employ the focus of the custom page and the home page. I am thinking the home page should emphasize colored marbles, and the custom page should emphasize custom colored marbles. My fear is that making such a drastic change will bounce the site completely off front page and that it will take time for the custom page to come up in rankings. AS it stands now I am confused as to how it even ranks on first page as there's two pages with custom colored marbles emphasis. Id like to clean this up as much as possible so there are no big hits with future google updates, but I don't want the site to drop off either as that would be hard to explain to the owner. Yeah, we are cleaning up your site and making it google compliant and in so doing you no longer rank on first page. That won't put food on the table. Thanks for any advise on this.
On-Page Optimization | | anthonytjm0