Advice urgently needed on best practice for handling multiple product categories on Magento website
-
I have an ecommerce site built using Magento and urgently need advice on best practice for handling multiple product categories (where products appear in more than one category on the site creating multiple URLs to the same page).
In April this year, based on advice from my SEO who felt that duplicate content issues were causing my rankings to be held back, I changed about 25% of the product categories to 'noindex, follow'. This has made organic traffic fall (obviously) as these pages fell out of Google's index. But, contrary to what I was hoping for, it didn't then improve rankings - not one iota, nothing - which was the ONLY reason why I did this. This has had a real negative impact on sales, so I'm starting to think this was actually an a terrible idea.
Should I change them back?
And to ask a wider question, what is best practice for this particular scenario?
-
Hi,
If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing).
As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok.
Good luck!
-
Thanks, I have regenerated the xml sitemap. Fingers crossed it doesn't take too long to see the pages fall back into the index!
As it happens, my developer has since emailed back to say that there is a canonical link for each category but it points to itself. Is that a problem?? He can't tell me.
Thinking about it, I'm unsure about manually adding a canonical link for each product/category. I'm concerned about errors creeping in over time, with URL changes, etc. With hundreds of products, I think it won't be too difficult for this to happen. Plus, the XML is automatically generated, so don't think the URLs will match. Have you had encountered these problems before?
-
HI,
For the canonicals if they are not being added automatically at the category level then you can still do it just removing the first part of the above that removes the old url, so like this:
<reference name="head"><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/canonicalUrl</href></action></reference>The above will add a canonical tag to whichever category page you add it to (in the layout update box).
The fetch as google does not reindex your site, it just previews how google sees the site. Make sure all the category pages are included in your sitemap and resubmit the sitemap to GWT. You can then see how many pages in the sitemap are indexed and that number should go up as google recrawls the site and finds the noindex tag removed.
-
Thanks for taking the trouble to answer. I have now made all categories 'index, follow'.
No canonicals are automatically added to category pages, so can't use this technique. Thanks for the suggestion, though.
Should I 'Fetch as Google' in WMT? If so, is it best to add the URL for every single category that I've updated? Or, just wait?
Appreciate your help, Lynn.
-
Hi,
I would do it all at once, nothing unusual about it and google may not see the change on all pages at the same time anyway.
For the rankings it is really impossible to say, you might get lucky, you might have to be patient, its not exactly like starting over again, especially if you have a couple of existing external links but....
For the canonical tags, there is a way to do it depending on your setup. Have you got canonicals being automatically added to the category pages as well as the product pages? If yes then you can overwrite them on a case by case basis by putting the following code in the 'custom layout update' box (this works for both products and categories actually).
<reference name="head"><action method="removeItem"><type>link_rel</type>
<name>http://www.domain.com/oldurl</name></action></reference><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/new-url</href></action>You will need to identify the canonical url being inputted into the code, add it to the oldurl bit above to remove it and then put in the new canonical url you want. Needless to say, it pays to be sure about what you are trying to achieve and why before implementing this setup on a lot of pages.
Hope it helps!
-
The website uses Magento version 1.4. which actually does have the canonical link back to the base URL feature. This was in place already before I started even messing around with making these changes.
I will revert the categories back to 'index, follow'. Some questions about this:
- Is it best to do it all at once (or will this look odd/'unnatural' somehow from Google's perspective)
- How long will it take for these pages to re-rank? They were made noindex in April, so would it be like starting again as if these were totally brand new pages?
Another SEO has recommended another approach, which is to identify the 'best' URL (from SEO point of view) and add the canonical link to the rest. Is there a way to implement/manage this easily in Magento? I can't seem to find a solution online on this.
-
That Yoast plugin is only developed up to Magento version 1.4 which is pretty old now. The good news is you can get some of this functionality out of the box now at Admin -> Configuration -> Catalog -> Search engine optimizations. If you set the use canonical meta tag link on products to yes then all product pages are given a canonical link back to a base url with no category in it. Baring a more advanced paid module or custom development, this is going to be your best bet.
Certainly change your category pages back to index, follow. Depending on your setup and how many common categories/products you have any duplicate content issue you have would usually be on a product more than a category level anyway. For category pages look at getting some good descriptions and other unique content on them. Check out this video for more details.
-
Change them all back to INDEX, FOLLOW and use Canonical plugin by yoast.
Canonical URL's for Magento • Yoast (sorry if links not allowed)
Some products on our site appear in six categories and we have no issues with duplicate content whatsoever using the above.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Disallow: /404/ - Best Practice?
Hello Moz Community, My developer has added this to my robots.txt file: Disallow: /404/ Is this considered good practice in the world of SEO? Would you do it with your clients? I feel he has great development knowledge but isn't too well versed in SEO. Thank you in advanced, Nico.
Technical SEO | | niconico1011 -
Duplicate homepage content across multiple websites
Hi, I work for a company that runs 30+ membership based websites on separate domains and across multiple markets. The homepage for each site contains a section of content that highlights the site benefits and features. While each website serves a different market/niche, this section of content is essentially the same as each website offers the same benefits and features. What is the best way to avoid duplicate content issues while still being able to show the same section of content across 30+ sites? This particular section of content isn't valuable from an SEO perspective, but the rest of the content on that page is. Any ideas or suggestions would be much appreciated. Thanks
Technical SEO | | CupidTeam0 -
Website is not indexed in Google
Hi Guys, I have a problem with a website from a customer. His website is not indexed in Google (except for the homepage). I could not find anything that can possibly be the cause. I already checked the robots.txt, sitemap, and plugins on the website. In the HTML code i also couldn't find anything which makes indexing harder than usual. This is the website i am talking about: http://www.xxxx.nl/ (Dutch) The only thing that i am guessing now is the Google sandbox, but even that is quite unlikely. I hope you guys discover something i could not find! Thanks in advance 🙂
Technical SEO | | B.Great0 -
Multiple Sites Duplicate Content Best Practice
Hi there, I have one client (atlantawidgets.com) who has a main site. But also has duplicate sites with different urls targeting specific geo areas. I.e. (widgetmakersinmarietta.com) Would it be best to go ahead and create a static home page at these add'l sites and make the rest of the site be nonindexed? Or should I go in and allow more pages to be indexed and change the content? If so how many, 3, 5, 8? I don't have tons of time at this point. 3)If I change content within the duplicate sites, what % do I need to change. Does switching the order of the sentences of the content count? Or does it need to be 100%fresh? Thanks everyone.
Technical SEO | | greenhornet770 -
Best way to manage SEO for a massive events listing website.
I run a website that tracks entertainment for the entire state of South Dakota. While I've made some fantastic strides in gaining traffic, I feel lost on how to manage all those entries in an SEO friendly manner. I have a TON of errors showing on my crawl diagnostics and I just don't know what to do. The nature of the website is such that there are going to be duplications all over the place. I know that I can help some of this by getting my canonical links setup properly (that's coming in my next version of the site's theme), but what else should I do to make those event listings friendly for the SE's?? http://www.entertainsd.com
Technical SEO | | jcherland0 -
Links to Website Author
I'm a website developer, and in the past I have usually added a tiny backlink to the footer of my clients' websites like this: Website Design by MyCompanyName I understand that Google sees this as a low-quality backlink. However, I was wondering if such links can hurt my rankings. Does Penguin sees these links as spam? If so, should I add a rel="nofollow" to the links? Is there anything else I should change? I do not want to remove these links completely because they are good for marketing my business. I just want to minimize any negative SEO impact of the links. I appreciate your input. Thanks.
Technical SEO | | SiteWizard_LLC0 -
Need advice on search listings and link building
Search results on my keyword (engraved wedding glasses) produces several pages of linked domains. (My domain is giftthings.net) Some are good. And admittedly, some are not so good. My question then is simply, why does seomoz link analysis show such a small number of links? And the second part of my question is, "Is there some sort of "magic number", some sort of thresh hold that triggers Google's interest? With a link list that is small but growing, am I missing something in my concern that I'm not moving up in the search listings? I've written a few articles, continuing my work on link building but I remain buried in the search results.
Technical SEO | | AhmadS1 -
Website redesign launch
Hello everyone, I am in the process of having my consulting website redesigned and have a question about how this may impact SEO. I will be using the same URL as I did before, just simply replacing an old website with a new website. Obviously the URL structure will change slightly since I am changing navigation names. Page titles will also change. Do I need to do anything special to ensure that all of the pages from the old website are redirected to the new website? For example, should I do a page level redirect for each page that remains the same? So that the old "services" page is pointed to the new "services" page? Or can I simply do a redirect at the index page level? Thank you in advance for any advice! Best, Linda
Technical SEO | | LindaSchumacher0