Duplicate Content Showing up on Moz Crawl | www. vs. no-www.
-
Hello Moz Community!
I am new to SEO, Moz and this is my first question.
My questions; I have a client that is getting flagged for Duplicate Content. He is getting flagged for having two domains that have the same content i.e. www.mysite.com & mysite.com.
I read into this and set up a 301 redirect through my hosting site. I evaluated which site had a stronger Page Authority and had the weaker site redirect to the stronger site. However, I am still getting hit for Duplicate pages caused by the www.mysite.com & mysite.com being duplicates. How should I go about resolving this? Is this an example of a Canonical tag needed in the head of the HTML?
Any direction is appreciated. Thank You.
B/R
Will H.
-
Hello Dirk,
Thanks again for all of your help. So, I ended up not having the redirect setup correctly (I'm a noob!). For whatever reason, I could not setup the redirect using the redirect icon through the panel. I ended up accessing the .htaccess file (which was tough to find because it was hidden!). and I added this code.
RewriteEngine On
RewriteCond %{HTTP_HOST} ^www.YourDomain.com$ [NC]
RewriteRule ^(.*)$ http://YourDomain.com/$1 [R=301,L]All of my redirects are now redirecting from www. To non-www.
I'll have to wait for my next crawl to verify that the duplicate content has cleared, however, the redirect is indicating on httpstatus.io.
Thanks for your assistance Dirk!
B/R
Will
-
If the header checker indicates that the redirect isn't properly setup you will have to check the redirect rules. You could try to double check with web-sniffer.net. If the redirects are not ok waiting doesn't make sense - Moz will continue to find these errors (and Google as well).
Also indicate the preferred domain in Search Console (you will need to register both of them - the www & non-www version)
Dirk
-
Thanks Dirk!
I did set up the redirect about a week ago. I set it up on Monday or Tuesday. I checked the status using the tool recommend (Thanks for the link), and it indicates that no redirects are set up. I'll give it till Wednesday and retry it. I'm fairly confident the redirect was set up correctly.
-
If the redirection was done quite recently - it's possible that Moz hasn't recrawled your site (crawls are once/week)
If this isn't the case - check the http header of the pages which Moz indicates as duplicates, to be sure that they are properly redirected (with a tool like httpstatus.io).
Adding a canonical never hurts but it's better to solve the problem at the root.
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL slash creating duplicate content
Hi All, I currently have an issue whereby by domain name (just homepage) has: mydomain.com and: mydomain.com/ Moz crawler flags this up as duplicate content - does anyone know of a way I can fix this? Thanks! Jack
Technical SEO | | Jack11660 -
Duplicate Page Content Report
In Crawl Diagnostics Summary, I have 2000 duplicate page content. When I click the link, my Wordpress return "page not found" and I see it's not indexed by Google, and I could not find the issue in Google Webmaster. So where does this link come from?
Technical SEO | | smallwebsite0 -
Duplicate page content
hi I am getting an duplicate content error in SEOMoz on one of my websites it shows http://www.exampledomain.co.uk http://www.exampledomain.co.uk/ http://www.exampledomain.co.uk/index.html how can i fix this? thanks darren
Technical SEO | | Bristolweb0 -
Duplicate Content on Navigation Structures
Hello SEOMoz Team, My organization is making a push to have a seamless navigation across all of its domains. Each of the domains publishes distinctly different content about various subjects. We want each of the domains to have its own separate identity as viewed by Google. It has been suggested internally that we keep the exact same navigation structure (40-50 links in the header) across the header of each of our 15 domains to ensure "unity" among all of the sites. Will this create a problem with duplicate content in the form of the menu structure, and will this cause Google to not consider the domains as being separate from each other? Thanks, Richard Robbins
Technical SEO | | LDS-SEO0 -
Blocking AJAX Content from being crawled
Our website has some pages with content shared from a third party provider and we use AJAX as our implementation. We dont want Google to crawl the third party's content but we do want them to crawl and index the rest of the web page. However, In light of Google's recent announcement about more effectively indexing google, I have some concern that we are at risk for that content to be indexed. I have thought about x-robots but have concern about implementing it on the pages because of a potential risk in Google not indexing the whole page. These pages get significant traffic for the website, and I cant risk. Thanks, Phil
Technical SEO | | AU-SEO0 -
Www or no www
right now our organization has the a robot text file set to block search engines from indexing the non-www version of our URL - example.com looks like this #Dynamically generated robots.txt file for example.com
Technical SEO | | dschreib_greenpeace.org
User-agent: * Disallow: / Of course, we do allow search engines to crawl the www. version Is this the best way to do this?0 -
Htm vs. aspx page extensions & duplicate content
We have a client whose site is fairly new. There isn't much in the way of SEO results so far. In their content management system they have implemented friendly URLs and changed the extensions from aspx to htm. Now the htm pages are all indexed in Google but when I run a campaign report in SEOmoz it shows that all pages are duplicated with there being both htm and aspx pages for each page. Should we do 301 redirects from the aspx pages to the htm pages? Or would we be safe by removing the htm pages and letting Google reindex the site with the aspx page extensions? Does Google have any kind of preference as to what the page extensions are as long as the URLs include keywords?
Technical SEO | | IvieDigital0 -
Are recipes excluded from duplicate content?
Does anyone know how recipes are treated by search engines? For example, I know press releases are expected to have lots of duplicates out there so they aren't penalized. Does anyone know if recipes are treated the same way. For example, if you Google "three cheese beef pasta shells" you get the first two results with identical content.
Technical SEO | | RiseSEO0