My crawl diagnostic is showing 2 duplicate content and titles.
-
First of all Hi - My name is Jason and I've just joined - How you all doing?
My 1st question then:
When I view where these errors are occurring it says www mydomain co uk and www mydomain co uk/index.html
Isn't this the same page? I have looked into my root folder and only index.html exists.
-
Thanks Daniel!!!!
Looks like I'll be spending some time in the ol Q&A section
-
Hi Jason
That's perfect(and working) for redirecting all non www pages. You still need to decide on your original question regarding the index page!
Add the following to your htaccess file after the code you've already added :
RewriteCond %{THE_REQUEST} ^[A-Z]{3,9}\ /index\.html\ HTTP/ RewriteRule ^index\.html$ http://www.keystonemortgages.co.uk/ [R=301,L]
-
This is what I have added does it look OK?
Options +FollowSymLinks
RewriteEngine On
RewriteCond %{HTTP_HOST} ^keystonemortgages.co.uk
RewriteRule (.*) http://www.keystonemortgages.co.uk/$1 [R=301,L]
-
Thanks Alex I'll sit back and wait to see! fingers crossed it has a positive effect
-
It's not essential but still useful to have the canonical tag, it doesn't redirect but tells the crawlers the preferred address if you have more than one page/address containing the same content. It's particularly useful for duplicate content like print versions, or results pages based on query strings.
What you've actioned could improve the rankings to your homepage as before, the search engines will have seen the two addresses as separate pages, therefore competing against each other. When the redirect comes into effect the page authority and other metrics of both will be combined into one.
-
Hi quick update:
Just this mean I won't need a canonical tag in my header? Do they do similar things?
I've created the htaccess file and dropped it into my root folder at 1and1 so I guess now I sit back for a re crawl to see if it works?
One more thing. Is this likely to effect rankings?
-
Hey thanks Daniel cheers for the welcome
That sounds simple but I ain't got a clue how to do this so I'll start searching and let you know my results
Thanks for the lead,
Jason
-
Hi Jason and welcome to seoMoz!
If you do not have a rewrite in place(in your htaccess file) then both the www.mydomain.co.uk AND www.mydomain.co.uk/index.html will resolve in your browser. I suggest doing a 301 rewrite and while you're at it make sure you also rewrite all non www varients -> eg http://mydomain.co.uk 301 redirect that to http://www.mydomain.co.uk
You can then go set your preferred version in your Webmaster Tools.
This would be the code for apache(check with your host/developer if you're unsure) :
RewriteEngine On
RewriteCond %{HTTP_HOST} ^example.co.uk
RewriteRule (.*) http://www.example.co.uk/$1 [R=301,L]
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Next JS and Missing content
Hello
Moz Pro | | 4thWhale
We recently migrated our page to next JS which is supposed to be great for SEO
On almost all our pages we are getting the same errors Missing Canonical Tag Missing Title Missing or Invalid H1 Missing Description We don't understand this because we have all of that content on every page. We believe that maybe NextJs is having a incompatibility with Moz. Has anyone had any experience with this?0 -
Duplicate content on SearchResults.asp
hi guys. I'm currently working through the reported crawl errors in Moz Analytics, but an unsure what to do about some of them. for example... Searchresults.asp?search=frankie+says+relax is showing as having duplicate page content and page title as SearchResults.asp?searching=Y&sort=13&search=Frankie+Says+Relax&show=24 There's all sorts of searchresults.asp page being flagged. Is this something i can safely ignore or is it something i should endeavour to rectify? I'm also getting errors reported on shoppingcart.asp pages as well as pindex.asp (product index). I'm thinking i should maybe add disallow/ shoppingcart.asp to my robots text file, but am unsure as to whether i should be blocking robots from the search results pages and product index (which is essentially a secondary sitemap). Any advice would be greatly appreaciated. Thanks, Dave 🙂
Moz Pro | | giddygrafix0 -
Member Only Content
I run a wordpress based website that contains a large amount of free content, but also a large amount of content that is only accessed via a paid membership. After running a SEOmoz campaign for the site, it showed 3600 errors for duplicate page titles and 1900 errors for duplicate page content. After looking into the errors it became clear that the majority of them were due to the fact that if you clicked on a link to paid content, it would take you to the paid membership sign in page. So how to I go about fixing these errors? I don't want this to hurt my rankings. Or fix it if it already has.
Moz Pro | | CobraJones950 -
Duplicate content error?
I am seeing an error for duplicate content for the following pages: http://www.bluelinkerp.com/contact/ http://www.bluelinkerp.com/contact/index.asp Doesn't the first URL just automatically redirect to the default page in that directory (index.asp)? Why is it showing up as separate duplicate pages?
Moz Pro | | BlueLinkERP0 -
Crawl Diagnostics returning duplicate content based on session id
I'm just starting to dig into crawl diagnostics and it is returning quite a few errors. Primarily, the crawl is indicating duplicate content (page titles, meta tags, etc), because of a session id in the URL. I have set-up a URL parameter in Google Webmaster Tools to help Google recognize the existence of this session id. Is there any way to tell the SEOMoz spider the same thing? I'd like to get rid of these errors since I've already handled them for the most part.
Moz Pro | | csingsaas0 -
How to resolve Duplicate Content crawl errors for Magento Login Page
I am using the Magento shopping cart, and 99% of my duplicate content errors come from the login page. The URL looks like: http://www.site.com/customer/account/login/referer/aHR0cDovL3d3dy5tbW1zcGVjaW9zYS5jb20vcmV2aWV3L3Byb2R1Y3QvbGlzdC9pZC8xOTYvY2F0ZWdvcnkvNC8jcmV2aWV3LWZvcm0%2C/ Or, the same url but with the long string different from the one above. This link is available at the top of every page in my site, but I have made sure to add "rel=nofollow" as an attribute to the link in every case (it is done easily by modifying the header links template). Is there something else I should be doing? Do I need to try to add canonical to the login page? If so, does anyone know how to do it using XML?
Moz Pro | | kdl01 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
Crawling a website with redirects
Hi, I started a campaign for a website which uses multiple redirects before showing the real content. in the crawling report only one page is crawled. Is there a way to let the crawler pass the redirects to get usefull reports? The website is www.cegeka.be Thank you
Moz Pro | | Cegeka0