Duplicate content issue. Delete index.html and replace with www.?
-
I have a duplicate content issue. On my site the home button goes to the index.html and not the www. If I change it to the www will it impact my SERPS? I don't think anyone links to the index.html.
-
When you say "delete", do you mean delete it from the home button (and just use the root version), or delete the page? Keep in mind that the "index.html" page also drives the root version of the site ("www.example.com/"), so you definitely don't want to delete that file.
Whether you use 301-redirects or canonical tags (either should be ok, but it sounds like the canonical tag would be easier for you to implement), it is important to use a consistent path. So, you do need to change the button link to match the canonical version of the URL. Don't do this until after you've got either the 301 or canonical tag in place.
-
Remember, if you put this in the PHP code, it has to be conditional - you don't want to redirect your canonical version unnecessarily. Since your home-page is just one template, you'd be firing a 301 for every situation.
-
Well the canonical will be different for every page...so if your page is:
www.jeremygower.com/contact/index.php
your canonical would be:
Basically, what that says is..."hey google, it doesn't matter what URL you think you're at, make sure that the only one in your search engine is the one in the canonical tag"...therefore, be very careful with it as well. If you simply put www.jeremygower.com as the canonical for every page, google would de-index every other page of your site.
Anywhere in the head is good.
IMO, unlimited ends up being a bad thing...the way those things work is that godaddy (or whoever) puts a ton of websites on the same server, so think about the 500 or so other sites with 'unlimited' bandwidth using your server. It makes it slow...for instance there's about 400 domains on the same server as my domain, and yes, it's slow a lot of the time...the cheap plan on a small orange I'm sure is similar but I'd expect better quality than godaddy. (they dont have unlimited)
-
I use dream weaver as my HTML editor, I templated out my site so I wonder if I can just put the code at the top of the template and have it update every page on my site. Now where in the head do I put the code? At the very beginning? Also I know yahoo, godaddy and others promote unlimited bandwidth and storage while others have a tiered plan. Isn't it better to have unlimited? I'm just asking since there is an up charge if you go over the bandwidth or storage on the other hosting plans. Thank you for your help.
-
header ('HTTP/1.1 301 Moved Permanently');
header ('Location: http://www.whatever.com/whatever.php');
-------- As far as I know there's no difference...to Google a 301 is a 301 no matter where you tell it. Would still be a pain in the butt, though - and I'm not sure 100% efficient....the best thing (i think) would be to have a canonical on every single page, then that will take care of it from the search engine standpoint. However, I'd still go somewhere that allows rewrites...that's just crazy. Even my godaddy shared hosting allows htaccess. Dont go to Godaddy shared hosting - it's awful. Not sure where to get cheap hosting with htaccess, but I'd venture to say that most hosts support it. I'd look into a small orange, it's offered as a pro perk through SEOmoz for 3 months at half price and it looks like they offer $20/mo plans for business - or if you wanna try it $35/yr plan as well. From my experience, as long as you do it correctly, changing hosts will not affect your SERPs. We actually moved in January and saw nothing change.
-
Also is using a php code a real 301 redirect or no? Do you have a sample php code that I could use? I'm still in learning mode.
-
Which hosting company do you prefer? Which one is best for seo purposes? And how do I transfer without impacting my SERPS or does it have no impact?
-
Well, 301 would be best...but I suppose in that situation what I'd do is use the canonical tags...but that's a pain as you'd need to do it for like every page...
In short, that's just whack...I'd find a new host.
Edit: P.S. Why can't yahoo just die already?
-
I should put the code in the head right? Thank you.
-
Thank you, I am trying to figure out how to do the 301 redirect but when i asked yahoo they say that the php code is not a real 301 redirect when I asked them. And they only do the 301 redirect on the ecommerce hosting plans which I have no need for. Any insight? Thanks for your answer.
-
Just to follow up on this. the meta tag for this is
-
You should have a 301 redirect setup so that everything goes to one address, ie. www.jeremygower.com....so that no matter if they type index.html or www.jeremygower.com/ or jeremygower.com it all goes to the same place. Other than that, an easier method (and you should probably do both...just put a canonical tag on that page, then no matter what the main page will get the link juice.
And yes, it probably will - either way, you should fix it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you use no-index to counter duplicate content across separate domains?
Hi Moz Community, I have a client who is splitting out a sub brand from a company website to its own domain. They have lots of content around the theme and they want to migrate most of the content out to the new domain, but they also wanted to keep that content on the main site as the main site gets lots of traffic. My question is, as they want search traffic to go to the new site, but want to keep the best content on the original site too, so it can be found in the nav, if they no-index identical content on main site and index content on the new site will they still be penalised for duplicate content? Our advice has been to keep the thematic content on both sites but make them different enough so they are not considered duplicate - we routinely write the same blog post in 50 different ways for them but their Head of Web asked if the no-index is a route, which means they don't need to pay for and wait for brand new content? They are comfortable in losing traffic until the new domain gets traction. In theory, if they are telling Google not to index or rank the main site content, the new site shouldn't be penalised but I'm not confident giving that advice as I've never been asked to do this before. Thoughts?
Technical SEO | | Algorhythm_jT0 -
Indexing Issue of Dynamic Pages
Hi All, I have a query for which i am struggling to find out the answer. I unable to retrieve URL using "site:" query on Google SERP. However, when i enter the direct URL or with "info:" query then a snippet appears. I am not able to understand why google is not showing URL with "site:" query. Whether the page is indexed or not? Or it's soon going to be deindexed. Secondly, I would like to mention that this is a dynamic URL. The index file which we are using to generate this URL is not available to Google Bot. For instance, There are two different URL's. http://www.abc.com/browse/ --- It's a parent page.
Technical SEO | | SameerBhatia
http://www.abc.com/browse/?q=123 --- This is the URL, generated at run time using browse index file. Google unable to crawl index file of browse page as it is unable to run independently until some value will get passed in the parameter and is not indexed by Google. Earlier the dynamic URL's were indexed and was showing up in Google for "site:" query but now it is not showing up. Can anyone help me what is happening here? Please advise. Thanks0 -
Duplicate content or an update ???
Buying Guide and Product Category page competing for the same keyword ? Got a “nuts and bold website” selling basic stuff. Imagine selling simple nuts, bolts and washers (the little ring that goes in between) in different metals. Imagine a website with a very wide and deep line of these simple products. For long tail keywords we rank well (Example: 0.25 inch bolts). For the keyword: “Nuts bolts” our main category page use to rank well low 1<sup>st</sup> page to second page up against the big guys (Amazon, Walmart, Target, Costco, some drug store who may have a mix pack of nuts and bolts, but still Google don’t see the difference and list 2 pages each for these guys). But then in mid-February there were an update and suddenly our “Buying guide for nuts and bolts” rank higher and started to compete with our own product category page. That was never our intention. These two pages now compete for the ranking on page 4<sup>th</sup>. Clearly there were more words on the buying guide page but no changes had been made to it for well months or years. To make up for it some more words were added to the category page, but of cause there is only so many way you can fraise words about “nuts and bolts” without sounding a bit duplicate/re-writing. So what do I do now ?? Clearly the product category page is the one we like to rank highest with the guide a close 2nd. Most customer don’t need the buying guide but it is good to have and great support as we got lot of good comments from customer who read it. Made a link to the buying guide from the category page and wise verses. The category page got an embedded video. Moz list the page authority for the category page to 16 and 1 for the buying guide but clearly G see it differently. Already tried to change the Meta Tag Title and Description a little but it is hard to do if the word “Nuts Bolts” is to appear in the description or people don’t know what to expect. Could just insert a “do not index” for the buying guide but not a good long term solution. Unfortunately I am out of imagination at this point. Any good suggestions ?? Thanks, Kim Any good suggestions ???
Technical SEO | | KimX0 -
Development Website Duplicate Content Issue
Hi, We launched a client's website around 7th January 2013 (http://rollerbannerscheap.co.uk), we originally constructed the website on a development domain (http://dev.rollerbannerscheap.co.uk) which was active for around 6-8 months (the dev site was unblocked from search engines for the first 3-4 months, but then blocked again) before we migrated dev --> live. In late Jan 2013 changed the robots.txt file to allow search engines to index the website. A week later I accidentally logged into the DEV website and also changed the robots.txt file to allow the search engines to index it. This obviously caused a duplicate content issue as both sites were identical. I realised what I had done a couple of days later and blocked the dev site from the search engines with the robots.txt file. Most of the pages from the dev site had been de-indexed from Google apart from 3, the home page (dev.rollerbannerscheap.co.uk, and two blog pages). The live site has 184 pages indexed in Google. So I thought the last 3 dev pages would disappear after a few weeks. I checked back late February and the 3 dev site pages were still indexed in Google. I decided to 301 redirect the dev site to the live site to tell Google to rank the live site and to ignore the dev site content. I also checked the robots.txt file on the dev site and this was blocking search engines too. But still the dev site is being found in Google wherever the live site should be found. When I do find the dev site in Google it displays this; Roller Banners Cheap » admin dev.rollerbannerscheap.co.uk/ A description for this result is not available because of this site's robots.txt – learn more. This is really affecting our clients SEO plan and we can't seem to remove the dev site or rank the live site in Google. In GWT I have tried to remove the sub domain. When I visit remove URLs, I enter dev.rollerbannerscheap.co.uk but then it displays the URL as http://www.rollerbannerscheap.co.uk/dev.rollerbannerscheap.co.uk. I want to remove a sub domain not a page. Can anyone help please?
Technical SEO | | SO_UK0 -
Avoiding duplicate content on product pages?
Hi, I'm creating a bunch of product pages for courses for a university and I'm concerned about duplicate content penalties. While the page names are different and some of the test is different, much of the text is the same between pairs of pages. I.e. a BA and an MA in a particular subject (say 'hairdressing' will have the same subject descriptions, school introduction paragraph, industry overview paragraph etc. 1. Is this a problem? In a site with 100 pages, if sets of 2 pages have about 50% identical content... 2. If it is a problem, is there anything I can do, other than rewrite the text? 3. From a search perspective, would both pages show up in search results in searches related to 'hairdressing courses' 'study hairdressing' etc? Thanks!
Technical SEO | | AISFM0 -
Issue: Duplicate Page Content
Hi All, I am getting warnings about duplicate page content. The pages are normally 'tag' pages. I have some blog posts tagged with multiple 'tags'. Does it really affect my site?. I am using wordpress and Yoast SEO plugin. Thanks
Technical SEO | | KLLC0 -
Duplicate Content
We have a main sales page and then we have a country specific sales page for about 250 countries. The country specific pages are identical to the main sales page, with the small addition of a country flag and the country name in the h1. I have added a rel canonical tag to all country pages to send the link juice and authority to the main page, because they would be all competing for rankings. I was wondering if having the 250+ indexed pages of duplicate content will effect the ranking of the main page even though they have rel canonical tag. We get some traffic to country pages, but not as much as the main page, but im worried that if we remove those pages and redirect all to main page that we will loose 250 plus indexed pages where we can get traffic through for odd country specific terms. eg searching for uk mobile phone brings up the country specific page instead of main sales page even though the uk sales pages is not optimized for uk terms other than having a flag and the country name in the h1. Any advice?
Technical SEO | | -Al-0 -
Duplicate Homepage: www.mysite.com/ and www.mysite.com/default.aspx
Hi, I have a question regarding our client's site, http://www.outsolve-hr.com/ on ASP.net. Google has indexed both www.outsolve-hr.com/ and www.outsolve-hr.com/default.aspx creating a duplicate content issue. We have added
Technical SEO | | flarson
to the default.aspx page. Now, because www.outsolve-hr.com/ and www.outsolve-hr.com/default.aspx are the same page on the actual backend the code is on the http://www.outsolve-hr.com/ when I view the code from the page loaded in a brower. Is this a problem? Will Google penalize the site for having the rel=canonical on the actual homepage...the canonical url. We cannot do a 301 redirect from www.outsolve-hr.com/default.aspx to www.outsolve-hr.com/ because this causes an infinite loop because on the backend they are the same page. So my question is two-fold: Will Google penalize the site for having the rel=canonical on the actual homepage...the canonical url. Is the rel="canonical" the best solution to fix the duplicate homepage issue on ASP. And lastly, if Google has not indexed duplicate pages, such as https://www.outsolve-hr.com/DEFAULT.aspx, is it a problem that they exist? Thanks in advance for your knowledge and assistance. Amy0