Fixing my sites problem with duplicate page content
-
My site has a problem with duplicate page content. SEO MOZ is telling me 725 pages worth. I have looked a lot into the 301 Re direct and the Rel=canonical Tag and I have a few questions:
First of all, I'm not sure which on I should use in this case. I have read that the 301 Redirect is the most popular path to take. If I take this path do I need to go in and change the URL of each of these pages or does it automatically change with in the redirect when I plug in the old URL and the new one? Also, do I need to just go to each page that SEO MOZ is telling me is a duplicate and make a redirect of that page?
One thing that I am very confused about is the fact that some of these duplicates listed out are actually different pages on my site. So does this just mean the URL's are too similar to each other, and there fore need the redirect to fix them? Then on the other hand I have a log in page that says it has 50 duplicates. Would this be a case in which I would use the Canonical Tag and would put it into each duplicate so that the SE knew to go to the original file?
Sorry for all of the questions in this. Thank you for any responses.
-
That code should automatically 301 redirect all urls with www in them to non www versions - you can check if this is working properly with this tool (for the moment I do not see the redirect working though).
So for any duplicates you are seeing because of that specific issue this will fix them.
You should then wait for the next moz crawl to happen and should see less duplicates (since these ones will be removed) - this will show you what duplicate issues are still apparent (as mentioned there are a number of reasons that duplicate content can occur) and then you can focus on what kind of duplicates they are and what fix(es) may be needed to address them.
It is best to fix one thing at a time and not pile a whole bunch of changes you are not sure about on top of each other - it keeps it easier to bug track if something goes wrong!
-
The link was very helpful. With the code that it shows you to use and my site having more than one duplicate would I need to add on to it for the "examples"?
So: (my writing is all in caps in this code)
#Force non-www:
RewriteEngine on
RewriteCond %{HTTP_HOST} ^www.KILLBILLET.com [NC]
RewriteRule ^(.*)$ http://KILLBILLET.com/$1 [L,R=301]is this really all I need? I do not need to enter in all of the URLs that lead to this homepage? Or am I thinking far too simply with this?
I greatly appreciate how much help you have given me. I will be looking into all the other things and if they are beyond me then I will get further help. -
HI,
So this is a different site and I don't think a rel canonical in the index.php is what you want, especially for a www/non www duplicate issue which is best solved with an htaccess 301 redirect. I am not familiar with that forum software but I would be very careful about putting canonical tags in if you are unsure what a particular file is or where it will be displayed - you might end up with the same tag for the entire site which would not be good at all!
Its best to try to take it one thing at a time, do a correction you are sure will fix one of your duplicate issues and then maybe wait for the next moz crawl which will have less issues and make it easier to focus on the remaining ones and investigate on the best way to solve them.
For the www or non www redirects you would usually put a couple of lines in your .htaccess file in your root directory, you can check out this link for the exact code and how to do it through cpanel. I would suggest taking a backup of the existing file in case you need to restore it quickly (typos can take a site down easily). If you have a developer who is familiar with this kind of thing it might be worth asking them to assist.
-
Thank you very much for the informative post and video. I have watched the video especially several times.
I have yet another question. One of my duplicate pages is the home page. This is a www no-www problem it looks like:
http://www.killbillet.com/forum.php?s=9b0841ea53f918d77f12ba32487df7cahttp://www.killbillet.comHowever, when I go to the /cpanel of my site and try to put in a rel=canonical in the index.php file i find this:
/* Tell forum.php to redirect
to the default url as defined
in the navigation manager */
define('VB_REDIRECT', true);Doesn't this already mean it is supposed to be redirected and shouldn't have a duplicate?
On top of that I am unsure of how to find each duplicate page. Yes, I understand that index.php is my homepage but if I find index.php in the includes is this the duplicate of the homepage even though the file size is different? And is this where the canonical is meant to go?
-
HI,
For the category pages that is more an issue of thin content - there is so little unique content on the pages that they are being flagged as duplicate. I would think your best bet in this case would be to get some more text in there describing the advantages/qualities etc of the relevant manufacturer - make the pages more unique in other words.
For the cart page, that is indeed a duplicate content issue due to url parameters. Is that a custom coded site or a CMS? I dont know what if anything those parameters do in real life (the refurl is for internal tracking?) but in this case a 301 is not what you want. A canonical to 'cart.php' is a possibilty, or maybe just meta tag NOINDEX the entire cart page if it has no seo value anyway.
There are quite a few variables to take into consideration, I would recommend reading up a bit on it, particularly this post on thin/duplicate content and this video on common ecommerce seo pitfalls (it is a great video, watch it all!).
-
Hi there! Thank you for your response!
Here is an example of pages that are very similar (But ARE different pages) but the URLS are different: (20 duplicates)
http://www.maxamps.com/categories.php?cat=90
http://www.maxamps.com/categories.php?cat=86
Here is an example of the login page which has 50 duplicates but all lead to the same place; the login page:
http://www.maxamps.com/cart.php?mode=login&refurl=%2Fproducts.php%3Fcat%3D408
http://www.maxamps.com/cart.php?mode=login&refurl=%2Fproducts.php%3Fcat%3D259
http://www.maxamps.com/cart.php?mode=login&refurl=%2Fproducts.php%3Fcat%3D252
I assume this would be because of costumer ID numbers possibly? However, it is before signing in.
I obviously have pages that are very similar with their products and this must be the issue. However, as you said, I don't want to lose all of the other content by redirecting everything to this one page. The canonical does not seem correct either because they are not the same page over and over so I am really lost as to how I fix this, especially because I did think that this was mostly a URL issue.
-
Hi,
What you should do depends on what the issue is. 301's are useful if your duplicate issues are due to both www and non www urls being available to the search engines. The canonical tag is useful if you have url parameters that are causing duplicate content or if you have a multi capitalisation issue with your urls. There are other possibilities for the root cause, so first thing to do is properly identify what is causing the duplicate content issue for each case (there might be various reasons). What kind of duplicates they are will then guide you as to the best way to approach the solution. You can check out this moz guide for a good rundown on potential issues and solutions.
Without knowing your site it is tough to tell the exact issue, but:
Duplicate content is related to the page content itself, not the url - so if you are seeing different pages all flagged as duplicate it likely means the actual content on them is very similar. If you 301 redirect these pages then only the final page the 301 redirects to will still be available to users and search engines - so be sure this is what you intend to do. If for example these are pages for different (but similar) products then you would likely not want to do this.
The login page - depending on the issue (perhaps url parameters?) this is likely a good candidate for a rel canonical - in this case you put the canonical tag in each page version - most CMS's will do this automatically for all versions of the page if you set it up properly.
Hope that helps a bit!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site appears then disappears from Google
Hi, This is my first post to the Moz community. I hope someone can help me, as I'm at my wits end 🙂 Since mid to late April, my client's home page keeps dropping from Google rankings on and off on the desktop in incognito and non-incognito browsing. It seems to always be visible on mobile phones though. One day it's on page 4, the next day it's not anywhere to be found (even though some of her other pages rank). The site is here: evgeniaribinik.com I have done some blog writing (just text) for this client over the last few months, and recently she asked for some SEO help. After looking at her website, I noticed that she had a plugin called WordPress SEO on her site. She wasn't using this for the blogs, however. I don't think she did much of anything with SEO, but she did say that for the last few years, she was always on page 3 or 4 of Google. In mid/late April, she saw that she wasn't ranking at all for the keyword "boudoir photography nyc" anymore, despite a few years of ranking for it. I told her Yoast would be good to use. However, after she installed it, the same issues keep happening. Right now, she has Yoast and WordPress SEO plugins installed (I'm not sure if this is causing an issue as well). But I really can't figure out why she keeps going on and off page 4. She also asked me to optimize older blogs that she wrote herself for SEO. When I look at them, they don't have meta descriptions, good titles or good keywords. I realize this is hurting her, but why would her site be fine for years and all of a sudden not now? Thank you in advance for any help you can give me! Jill
Web Design | | lobeng770 -
New ecommerce site: Close old site and full domain redirect or keep it linking to new site?
We have rebranded and are working on our new site (B). Our old site (A) has a much higher domain/page authority than our new site. Currently we have the original Site A still there, with all links/pages pointing to the new Site B when people click. I am unsure whether we'd be best to close down the Site A completely and do a full domain redirect to Site B. Site A: 10 years age and has a moderate amount of links to it.
Web Design | | ModowestNZ
Homepage - PA: 24 DA:11 Site B: 6 months age, few links
Homepage - PA: 1 DA:2 My concern with the full domain redirect is that the indexed/ranking pages would dissapear. The benefit is less brand confusion for our niche range of party accessories.0 -
Attachment Pages
i have hundreds/thousands of images on my site, but for some reason the images on this page - http://indigocarhire.co.uk/top-of-the-range-car-hire/ - are being flagged as attachment pages, meaning im getting errors for duplicate titles, missing metas ect why are these images and only these ones being flagged up, they have been added in exactly the same way as every other image on the site appreciate any advice Thanks
Web Design | | RGOnline0 -
How to make sure category pages rank higher than product pages?
Hi, This question is E-Commerce related. We have product categories dividing products by color. Let's say we have the category 'blue toy cars' and a product called 'blue toy car racer', both of these could rank for the keyword 'blue toy car'. How do we make sure the category 'blue toy cars' ranks above the product 'blue toy car racer'? Or is the category page automatically ranked higher because of the higher page authority of that page? Alex
Web Design | | WebmasterAlex0 -
Build New Site Without Losing Rankings
Good morning SEOmoz community. I have a question which I am pretty sure I already know the answer to, however i thought I would reach out to my fellow experts to see if anyone had some great advice. I would really like to give my website a makeover. i have two thoughts on this, one is to scrap the site completely and start fresh, the other would be to only change it visually, but keep all the content and on-page optimization. I am terrified of losing my rankings. I am ranked position 1 and 2 for highly competitive terms and have another 15 - 20 keywords on page 1. Any advice would be tremendously appreciated!!!
Web Design | | WebbyNabler0 -
Schema.org - Right way to mark the pages
Dear all, Almost since we started designing our site, we are using schema microdata. It is not only because of the rich snippets, but because I want the search engines to better understand what we have. For example, the +1 buttom would not work properly without schema microdata, because it kind of ignores the OpenGraph parameters that specified image and description; and since we are a (very small) local bussiness directory (between other things), all our clients have a hand written schema complient description on their lisings, including address, opening ours, telephone number, description, etc. It is hand written by us because the tools avialable are simply not good enough to cover all different scenarios that a listing can present. I have not use, until today, a proper for the homepage, and it is probably the cause that our page lost the nice links below the site description in the google snippet. I did not place it on the body tag, but near the description, closing it inmediately after the description finishs. Now this is solved and we will wait to see if the links come back in the next weeks. Now to the question. Our site has three sections, with three different systems installed, two running wordpress and a third running another script. the main site is the local bussiness directory. The front page is mark as "schema.org/WepPage", and I do not know how to mark the other pages of the main site. I was thinking of marking the listings as "schema.org/ItemPage" since they are related to specific clients. Would you consired it to be right? Then, we have landing pages for the categories, should they be mark as WepPage, or as an Article, or something else? Many thanks in advance for your help, Best Regards, Daniel
Web Design | | te_c0 -
Considering site navigation options
I am working on a site redesign and re evaluating concepts I haven't thought about for a few years. I generally see site navigation that is either "top-down" or "left bar". Top down navigation normally uses the left nav. for search refinements. The benefit of top nav. is that it clears up the center of the page for non navigation content. The drawback is that you can't fit as many categories in a top nav. Left side nav. can hold a long list of categories, but subcategories are often in the center of the page. In the past, I have preferred to use left nav. with a multi level scroll over search refinement. I believe this allowed users to get to their destination page with fewer clicks. (I have always believed that every required additional click causes lost customers). I also believe that this has caused me to get more juice flowing to deeper pages on sites and better long-tail conversion. This means I have had pages with a LOT of links. With this method, I have tightly controlled my categories. What on other sites are often dynamic search refinements, are on my sites additional categories. I am considering making a site with a top down navigation system. I like the additional screen space in the center I get to work with. Is my assumption about pages created by search refinement wrong? Is it ok for SEO to have a left nav that has a bunch of search refinements that are dynamically created?
Web Design | | EugeneF0 -
What can this charity site do to improve SEO?
Hello wise ones, We have been working with the charity Volunteers of America to create a new site for their car donation program at carshelpingpeople.org They are a national charity with extensive local programs run by regional affiliates, so the site is divided into a small national section linked to Regional Affiliate sections. You get to the regional sections either by entering your zip code or clicking on your state in the bottom nav of the national pages. Right now we have developed regional sections for Michigan, Nevada, Maryland, Washington D.C., New Jersey, Delaware and the Philadelphia area. The site is about 2 1/2 months old, and while our conversion rate is pretty good (7%) our organic search ranking isn't improving as quickly as we'd like to see. Car donation is a very competitive space, and we would appreciate any advice on how to improve the SEO of the site. Thanks so much.
Web Design | | Phibnax0