Duplicate Content From My Own Site?!
-
When I ran the SEO Moz report it says that I have a ton of duplicate content.
The first one I looked at was my home page.
All of the above 3 have varying internal links, page authority, and link root domains. Only the first has any external links.
All of the others only seem to have 1 other duplicate page. It's a difference between the www and the non-www version.
I have a verified acct for www.kisswedding.com in google webmaster tools. The non-www version is in there too but has not been verified.
Under settings for the verified account (www.kisswedding.com), "Don't set a preferred domain" is checked off. Is that my mistake. And if so, which should I select? The www version or the non-www version?
Thanks!
-
Hi Ryan
I'm really sorry, but could you tell me what rule(s) to add to my htaccess file. I've been to my host (bluehost) but they don't know. Nice eh!?
I'd really appreciate it. And SO sorry!
-
I think I just had a major Duh! moment. Instead of linking back to index.html could I have been linking back to / all this time?
YES! Once you decide upon a correct URL structure for your website, you should always link directly to the appropriate URL.
On your site, you have chosen http://www.kisswedding.com/ to represent your home page. 100% of your links to the home page should use that URL. Any non-www links and /index.html links should be changed to this format.
Also, any signatures you use and content on other sites which you have control over should be updated to the proper format. Facebook, twitter, articles you published on other sites, etc. should all be updated.
-
omg.
I think I just had a major Duh! moment. Instead of linking back to index.html could I have been linking back to / all this time?
And thank you for confirming. Much appreciated. It all seems logical and it's all stuff I thought needed to happen - but was hoping didn't.
-
Your understanding is correct. The most important item is #3.
You asked how do you know the www version because is getting more links
Well, I was taking your word for it. In your original question you stated "Only the first has any external links."
Since you asked I just checked and actually all 3 URLs have external links, but the www version has by far the most.
With respect to the index.html file, it does not have to exist but that is the way your site is currently set up. Either way, it is ok. Simply 301 redirect the /index.html page to the / page.
What you need to understand is that while on your site the /index.html page is the same as the / page, it is not necessarily that way on every site. Additionally while on your site the www and non-www version of a URL is the same page, it is not necessarily that way on every site. For this reason Google will treat each of these pages separately. It will appear to Google that you are duplicating content. Also, your link juice will be divided. A properly configured 301 redirect will resolve these issues.
-
Thank you Maurizio!!! Just what I needed to know!
-
Thank you so much Ryan.
You answered a lot of the questions I was contemplating. Can you confirm I've understood your suggestions?
1. Verify the non-www version in GWT
2. Set preferred domain to the www version because that's getting more links (how do you know that btw?).
3. Set up 301 redirects in my htaccess file.
4. You've recommended that i set my home page as http://www.kisswedding.com VERSUS http://kisswedding.com/index.html or http://kisswedding.com
--- question about this last one. Isn't the index.html always going to exist because if I link back to my site within my own site I use the index.html extension? In fact, all my links are like that - I don't include my entire site url when i'm linking from one page to another on the site.
-
Hi Susan.
I agree with Maurizio and will offer a few more details.
It is important for each web page on your site to only be accessible from a single URL. It is up to you to decide which URL you prefer, then ensure all other URLs are removed or redirected to your chosen URL.
With respect to www or non-www, it does not make any difference but is rather your choice. In this case, since you already have links to the www version and not the non-www version, I would recommend choosing the www version and sticking with it.
The most important change you need to make is on your site. You need to 301 redirect all non-www URLs to their www equivalent. If you are unsure how to make this change and have managed hosting (most small sites do) then contact your host and they can easily make the change. Once the change has been made, test it! First go to your non-www home page and make sure you are redirected. Next, go to any of your inner pages, remove the "www" from the URL and make sure you are redirected to the same page but with the "www" added to the URL.
For Google WMT, you need to verify the site first. You should not have to upload any new file or change any code, but simply click through the options and the site will likely verify. Next, choose the preferred domain as the "www" version. If you wish to be very thorough, you can log into Bing Webmaster Tools and perform the same action. Once your 301 redirect is in place, the search engines would automatically make the change anyway, but it will likely take a month for all the pages of your site to be adjusted.
For the index.html, I would recommend 301 redirecting that URL to your http://www.kisswedding.com/ url.
Lastly, please review all links on your site and ensure they all use the "www" prefix. Include any signatures, social pages (facebook, twitter, etc).
-
Hi
i think that is not different from wwww and without wwww but you must decide in the google webmaster tools.
and i think that you can rediret (301 permanent) with htaccess to show only one site online.
example if you decide to have http://www.kisswedding.com/ when somebody digit a url without wwww ( http://kisswedding.com) you can redirect to wwww.
So you can avoid a duplicate content
Ciao
Maurizio
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New Site Worries
To cut a long story short, our old web developers who built us a bespoke site decided that they could no longer offer us support so we decided to move our back end to the latest Magento 2 software and move over to https with a new company. The new setup has been live for 3 weeks, I have checked in webmaster tools and it says we have 4 pages indexed, if I type in site:https://www.mydomain.com/ we have 6560 pages indexed, our robots.txt file looks like this:Sitemap: https://www.mydomain.com/sitemap.xml Sitemap: https://www.mydomain.com/sitemaps/sitemap_default.xml I use Website Auditor and Screaming Frog, Website Auditor returns a 302 for my domain and Screaming Frog returns a 403 which means I cannot scan any of these. If I check my domain using an https checking tool some sites return an error but some return a 200.
Reporting & Analytics | | Palmbourne
I have spoken to my new developer and he says everything is fine, in Webmaster tools I can see some redirects from his domain to mine when the site was in testing mode. I am concerned that something is not right as I always check my pages on a regular basis. Can anyone shed any light on this, is it right or am I right to be concerned. Thank you in advance0 -
Two long established sites with similar audiences, what do we do?
Hi guys, We operate two long established and reasonably well ranking sites — our company website which was built on a keyword domain: market-stalls.co.uk (approx 15 years online) and our online store which was established several years later on a different domain: tradersupplies.co.uk (approx 9 years online). (At the bottom of this post I've attached real world traffic and turnover figures that demonstrate the issue we're facing) The problem is... The above sites target very similar audiences and keywords and both rank fairly well but I know are likely competing against eachother We're a small company (8-10 employees) and we (or rather, I) don't have the time or resources to blog, build back links, manage opseo and all the social channels etc for both sites. I'm struggling to cope with one. The question is... Do we abandon the original company site (market-stalls.co.uk) in favour of pooling all our resource in to improving rankings for our online store (tradersupplies.co.uk). All our social media presence relates to tradersupplies.co.uk. We don't have any social channels for market-stalls.co.uk. Ironically, the only blog we have is established on market-stalls.co.uk — set up a couple of years ago in the hope to pull ourselves back up the rankings — but it hasn't been updated in over a year due to time restraints. Or do we attempt to keep both sites operational, despite a lack of resource? That would likely include a fairly sizeable overhaul of market-stalls.co.uk to bring it up to date with modern design standards, establishing social media channels for market-stalls.co.uk, creating a blog on tradersupplies.co.uk, and regularly updating two blogs and two sets of social media channels with unique content. Sounds like a pretty huge job right!? Obviously, had we been setting up our business in 2017 and having read the many community posts on the subject of multiple websites, we wouldn't be splitting our time between two websites and would be focussing solely on building one highly ranking site. But unfortunately we're not in this position and we're in a quandary because we don't know whether or not we should let our original, highly ranking company site drop off the radar in favour of focussing on building traffic to our online store. This situation arose out of a decision to establish our online store on a different domain to our company website. Back in 2007 I rebuilt market-stalls.co.uk and spent a lot of time optimising it. The site blew up and we were ranking very well for all kinds of keywords related to market stalls In 2009 we opened our online store tradersupplies.co.uk which sells all of the products advertised on market-stalls.co.uk and then some By using "buy now" buttons on market-stalls.co.uk which redirected to tradersupplies.co.uk, our original site was driving a large amount of traffic and sales to tradersupplies.co.uk. At it's peak it was driving almost £6,000 GBP a month in sales. This has since dropped to around a third/quarter of this total. As the business grew we began to run short of time to maintain market-stalls.co.uk and it has inevitably slipped down the rankings This has also had a direct impact on the referral traffic and resulting sales on tradersupplies.co.uk. I've attached below the analytics which show the drop in referral traffic to tradersupplies.co.uk and the drop off in sales. I have a feeling I know the answer to this debacle but I'm keen to hear the opinions of those that may have found themselves in this position before! UPDATE: I've just had a call with our Magento developer halfway through writing this post ... he has suggested we transfer all content from market-stalls.co.uk over to CMS pages on our Magento powered online store, and create 301 redirects. Apparently this will carry the weight of market-stalls.co.uk over to tradersupplies.co.uk. Does anyone have any thoughts on this? turnover.jpg
Reporting & Analytics | | tinselworm0 -
Multiple GA codes, one site.
Hi all, Is anyone running two GA codes on one website successfully? My organisation own a number of websites so we used to have one global GA code on all our sites to track global stats, and then we would also have site unique GA on each property to just track that one property. This worked fine, but of late we seem to be getting no data from the globally based code. Obviously, with the site-specific codes we can enter the name for that domain in GA but for the overall code, it is called 'all.com' I'm wondering if Google has now tied the GA domain to the code or if we are doing something wrong. All the codes are the same as they always were but have stopped working. As a stop gap, we have swapped to using Piwik as the all.com code. However, we are then comparing the stats in two different analytics programs so will get a different result. Also, it would be nice to be able to add the all.com to tools such as this to generate weekly reports. Anyone else having GA woe like this? Thanks. Carl
Reporting & Analytics | | WonkyDog0 -
Google Analytics Set-Up for site with both http & https pages
We have a client that migrated to https last September. The site uses canonicals pointing to the https version. The client IT team is reluctant to put 301 redirects from the non-secure to the secure and we are not sure why they object. We ran a screaming frog report and it is showing both URLs for the same page (http and https). The non-secure version has a canonical pointing to the secure version. For every secure page there is a non-secure version in ScreamingFrog so Google must be ignoring the canonical and still indexing the page however, when we run a site: we see that most URLs are the secure version. At that time we did not change the Google Analytics setup option to use: "https" instead of "http" BUT GA appears to be recording data correctly. Yesterday we set up a new profile and selected "https" but our question is: Does the GAnalytics http/https version make a difference if so, what difference is it?
Reporting & Analytics | | RosemaryB1 -
Google Analytics is treating my blog like all the content is just on the home page.
Hello all, I installed Google Analytics on a main website and a blog (blog.travelexinsurance.com) While it appears to be tracking correctly (and when I test it in real time it shows that I'm visiting) but it is treating the entire blog as though it's one page. So I can't see data on blog post X. All I see is that X visitors came to my blog in aggregate. So I see blog.travelex.com has 999 visitors, but it doesn't show that /travel-luggage got 50 visits, while /insurace-tips got 75 and so forth. I assume I screwed up the tracking somehow, but can't figure out where I went wrong. Tracking on the main domain works just fine. It's specific to the blog.
Reporting & Analytics | | Patrick_G0 -
Webmaster Tools Suddenly Asking For Verification of Site Registered for 5 Years
Google Webmaster Tools has been successfully installed on my website, (www.nyc-officespace-leader.com) for more than five years. Suddenly, today I have received a request to Verify this Site". This makes no sense. The only possibility I can think of is that this is somehow tied to the following events in the last month: 1. Launch of new version of website on June 4th
Reporting & Analytics | | Kingalan1
2. Installation of Google of Tag Manager
3. Sudden Increase in number of pages indexed by Google. Unexplained indexing of an additional 175 pages. About 625 pages should be indexed, while 800 are now indexed. In the last month ranking and traffic have fallen sharply. Could it be tat these issues are all linked? But the strangest issue is the request to verify the site. Does anyone have any ideas? Thanks,
Alan0 -
Wordpress site with increase number of Crawl(400 response Code) errors in Others section of GWT
I have a wordpress site http://muslim-academy.com/I check in Google Webmasters tool today and I see the increase number of errors in Others area of Google webmaster Tool.The error code is 400http://muslim-academy.com/%D8%B3%D9%8A%D8%B1%D8%A9-%D8%AA%D8%A7%D8%B1%D9%8A%D8%AE%D9%8A%D8%A9-%D9%84%D9%84%D8%B1%D8%A6%D9%8A%D8%B3-%D8%AC%D9%85%D8%A7%D9%84-%D8%B9%D8%A8%D8%AF-%D8%A7%D9%84%D9%86%D8%A7%D8%B5%D8%B1-2/%D8%B3%D9%....%3Cbr%20/%3E________________%3Cbr%20/%3E___________%3Ca%20href=?lang=zhOne of the example link of this error.Can you guide me why the number of errors are increasing and how to fix the existing errors.
Reporting & Analytics | | csfarnsworth0 -
Solving link and duplicate content errors created by Wordpress blog and tags?
SEOmoz tells me my site's blog (a Wordpress site) has 2 big problems: a few pages with too many links and duplicate content. The problem is that these pages seem legit the way they are, but obviously I need to fix the problem, sooooo... Duplicate content error: error is a result of being able to search the blog by tags. Each blog post has mutliple tags, so the url.com/blog/tag pages occasionally show the same articles. Anyone know of a way to not get penalized for this? Should I exclude these pages from being crawled/sitemapped? Too many links error: SEOmoz tells me my main blog page has too many links (both url.com/blog/ and url.com/blog-2/) - these pages have excerpts of 6 most recent blog posts. I feel like this should not be an error... anyone know of a solution that will keep the site from being penalized by these pages? Thanks!
Reporting & Analytics | | RUNNERagency0