What's my best strategy for Duplicate Content if only www pages are indexed?
-
The MOZ crawl report for my site shows duplicate content with both www and non-www pages on the site. (Only the www are indexed by Google, however.) Do I still need to use a 301 redirect - even if the non-www are not indexed? Is rel=canonical less preferable, as usual?
Facts:
- the site is built using asp.net
- the homepage has multiple versions which use 'meta refresh' tags to point to 'default.asp'.
- most links already point to www
Current Strategy:
- set the preferred domain to 'www' in Google's Webmaster Tools.
- set the Wordpress blog (which sits in a /blog subdirectory) with rel="canonical" to point to the www version.
- Ask programmer to add 301 redirects from the non-www pages to the www pages.
- Ask programmer to use 301 redirects as opposed to meta refresh tags & point all homepage versions to www.site.org.
Does this strategy make the most sense? (Especially considering the non-indexed but existent non-www pages.)
Thanks!!
-
Very informative - thank you! It seems when I think I have a relatively firm grip on SEO, I stumble upon something new - like the dangerous potential for an infinite loop in a 301 redirect in IIS. (That was Chinese to me two days ago;))
Your response solved my concerns - hopefully it will help somebody else when they face the same problem.
-
Well the reason Google has picked the www version as it's preferred version automatically is most likely because of all the links you mentioned that were already pointing to that iteration of your domain. Google can figure this out on their own. That said, it still sees both of the sites (non www and www) as duplicates of each other. Best practice is to 301 one to another.
I've waged this war with a programmer before so I know how it goes. The one I dealt with didn't think there was any reason and told me all websites work that way. So I asked him to go to http://google.com and tell me how it resolves. Repeat that step with every major brand you can think of until he/she gets the point and that might help you.
They should be able to 301 this one time, no matter whether they're using an Apache or IIS server. This should be a quick fix. If they're unsure how to do it, have them Google "IIS 301 redirects" if it's a Windows server or "htaccess 301" if it's a Linux/Apache server.
-
Thanks for easing my mind Jesse! One thing still confuses me - the fact that the non-www pages are not indexed. They are not disallowed in robots.txt, there are no rel=canonical tags (except for pages in the blog subdirectory), they are not meta-refreshed, and obviously not 301 redirected. Could it be the doing of a sitemap (though I cant find one)? Or did Google simply decide all the www pages were more relevant? Am I missing something here? I don't want to ask the programmer to add a ton of 301 redirects (which I did) only to get a 'DUH!' response;)
FYI - site is asp.net - not sure if that matters, except when they redirect homepage to avoid creating infinite loop. (right?)
Thanks again!
-
This is an incredibly easy topic to address because you've already laid out exactly what needs to happen.
In other words, yes! That strategy is exactly the way you should go.
Good job and good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate content report - question on best practice
Hello all, New to MOZ Pro and SEO - so lots to get my head round! I’m working through the Duplicate Content section of the Crawl report and am not sure what the best practice is for my situation. Background: We are a reference guide for luxury hotels around the world, but the hotels that are featured on the site vary year on year. When we add a new hotel page, it sets up the url as ourwebsite.com/continent/country/regionORcity/hotel. When the hotels come off, I redirect their URL to the country or region where we have other hotels. Example: http://www.johansens.com/europe/switzerland/zermatt/ The hotel in Zermatt has come off the site, showing 0 results on this landing page. Question: My duplicate content report is showing a number of these regional pages that are displaying the copy “0 places - Region’ because the hotel has come off, but the landing page is still live. Should I redirect the regional page back to the main country page? And then if I add a new hotel to the site from that region in the future, simply remove the redirect? Should I also delete the page? Any tips would be much appreciated!
Moz Pro | | CN_Johansens0 -
Duplicate Page
I just Check Crawl the status error with Duplicate Page Content. As Mentioned Below. Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://www.getmp3songspk.com Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://getmp3songspk.com and then i added these lines to my htaccess file RewriteBase /
Moz Pro | | Getmp3songspk
RewriteCond %{HTTP_HOST} !^www.getmp3songspk.com$ [NC]
RewriteRule ^(.*)$ http://www.getmp3songspk.com/$1 [L,R=301] But Still See that error again when i crawl a new test.0 -
Why does one page rank while a similar page doesn't?
We have a blog post (actually several of them that have the same SEO characteristics) that brings a fair amount of traffic to our site (relatively speaking), and according to Google Webmaster Tools it averages in the top 10 in SERPs for various terms. This page has no external links to it, and very few internal links pointing to it. When I run Moz's On-Page Grader for the various keywords it ranks for, the page get's an F on all of them. It was not optimized for any keyword, and it isn't our best content; it was a blog post written a few years ago and forgotten about and was never promoted in any way. The topic does happen to be about something that people search for frequently. According to the keyword difficulty tool, all of the keywords it ranks for have 40-45% difficulty. We have lots of other pages on our site that we have tried to optimize and that get A's and B's in On-Page Grader, that have both internal (from the home page and main menu) and external links pointing at them, etc, but they don't rank well at all. Keyword difficulty for these keywords is in the same range, from 37 - 53%. Why does this one page rank so well when the other pages don't? Additionally, we have been looking at a competitor who has a page that ranks #1 in universal results for numerous keywords according to SEMRush, yet the page gets an F On-page Grader for those keywords. The page has 3 links to it, all from the same domain and it has a very low domain and page authority. The Domain Authority of this page is 47 and the page authority is 33 according to Open Site Explorer (compared with our DA of 30, and PA of 1), and the social metrics are a bit higher than ours, but neither has a lot (they may have 15 likes to our 10). Why does this page rank so well for them? How can we get our Page Authority higher? Thanks for any and all help.
Moz Pro | | mukunig1 -
Why am I getting all these duplicate pages?
This is going for basically all my pages, but my website has 3 'duplicates' as the rest just have 2 (no index) Why are these 3 variations counting as duplicate pages? http://www.homepage.com http://homepage.com http://www.hompage.com/index.php
Moz Pro | | W2GITeam0 -
What's the best way to switch a campaign from sub-domain tracking to root domain tracking?
I realized after the fact that one of my campaigns also has a mobile website sub-domain that I'd like to track (ex: http://m.website.com). How can I switch this campaign over to root domain tracking without deleting everything and starting over?
Moz Pro | | CFW-SEO1 -
What's the best practice for tracking broad match traffic?
We use the Pro Web App for our keyword/ranking reporting. First, am I correct in assuming that this uses exact match to report the traffic? That being the case, is there a way in Moz (beyond entering endless permutations of our targeted keywords) to track traffic we're getting out of broad match searches? For example, say we optimized for and are tracking the keyword "lambada dancing llamas" for a company called Llarry's Llamas. Let's say that Moz reports little to no traffic for that keyword, but GoogleAnalytics indicates that we've gotten traffic from "larrys dancing llamas", "dancing llamas", "llarry llamas" and so on. So, obviously we're getting broad match traffic out of the lambada llamas, just not a lot of exact match, which is all that the Moz app shows. How do other people track this kind of traffic?
Moz Pro | | MackenzieFogelson0 -
Home and index.html isted as duplicate page
Hello, www.mountain-solutions.net and www.mountain-solutions.net/index.html are listed under an error for having a duplicate page. They are in fact the same page. I'm wondering how I can remedy this. Thanks
Moz Pro | | benfirth0 -
What's Your SEOmoz Favorite?
Obviously, SEOmoz is full of awesomeness. But I'm curious as to what sections, tools, etc. of SEOmoz are the users' favorites? For me, it's a close race between the blog, Linkscape/Open Site Explorer, and the search overlay tool on the Mozbar. What are your favorites?
Moz Pro | | Gyi0