Advice urgently needed on best practice for handling multiple product categories on Magento website
-
I have an ecommerce site built using Magento and urgently need advice on best practice for handling multiple product categories (where products appear in more than one category on the site creating multiple URLs to the same page).
In April this year, based on advice from my SEO who felt that duplicate content issues were causing my rankings to be held back, I changed about 25% of the product categories to 'noindex, follow'. This has made organic traffic fall (obviously) as these pages fell out of Google's index. But, contrary to what I was hoping for, it didn't then improve rankings - not one iota, nothing - which was the ONLY reason why I did this. This has had a real negative impact on sales, so I'm starting to think this was actually an a terrible idea.
Should I change them back?
And to ask a wider question, what is best practice for this particular scenario?
-
Hi,
If there already is a canonical link then you can edit it using the layout update code I first mentioned. If you do not need to canonical to another page you can just leave it as it is (self referencing).
As to if you want to do it or not, this really depends on how big of a problem it is for your search efforts and how many cats/products you will need to manually adjust. I would think that if you keep track of them in an excel and remember to check when you are updating that with a couple of hundred categories/products (of which only maybe a couple dozen or less might have to be manually edited?) then you should be able to manage it ok.
Good luck!
-
Thanks, I have regenerated the xml sitemap. Fingers crossed it doesn't take too long to see the pages fall back into the index!
As it happens, my developer has since emailed back to say that there is a canonical link for each category but it points to itself. Is that a problem?? He can't tell me.
Thinking about it, I'm unsure about manually adding a canonical link for each product/category. I'm concerned about errors creeping in over time, with URL changes, etc. With hundreds of products, I think it won't be too difficult for this to happen. Plus, the XML is automatically generated, so don't think the URLs will match. Have you had encountered these problems before?
-
HI,
For the canonicals if they are not being added automatically at the category level then you can still do it just removing the first part of the above that removes the old url, so like this:
<reference name="head"><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/canonicalUrl</href></action></reference>The above will add a canonical tag to whichever category page you add it to (in the layout update box).
The fetch as google does not reindex your site, it just previews how google sees the site. Make sure all the category pages are included in your sitemap and resubmit the sitemap to GWT. You can then see how many pages in the sitemap are indexed and that number should go up as google recrawls the site and finds the noindex tag removed.
-
Thanks for taking the trouble to answer. I have now made all categories 'index, follow'.
No canonicals are automatically added to category pages, so can't use this technique. Thanks for the suggestion, though.
Should I 'Fetch as Google' in WMT? If so, is it best to add the URL for every single category that I've updated? Or, just wait?
Appreciate your help, Lynn.
-
Hi,
I would do it all at once, nothing unusual about it and google may not see the change on all pages at the same time anyway.
For the rankings it is really impossible to say, you might get lucky, you might have to be patient, its not exactly like starting over again, especially if you have a couple of existing external links but....
For the canonical tags, there is a way to do it depending on your setup. Have you got canonicals being automatically added to the category pages as well as the product pages? If yes then you can overwrite them on a case by case basis by putting the following code in the 'custom layout update' box (this works for both products and categories actually).
<reference name="head"><action method="removeItem"><type>link_rel</type>
<name>http://www.domain.com/oldurl</name></action></reference><action method="addLinkRel"><rel>canonical</rel>
<href>http://www.domain.com/new-url</href></action>You will need to identify the canonical url being inputted into the code, add it to the oldurl bit above to remove it and then put in the new canonical url you want. Needless to say, it pays to be sure about what you are trying to achieve and why before implementing this setup on a lot of pages.
Hope it helps!
-
The website uses Magento version 1.4. which actually does have the canonical link back to the base URL feature. This was in place already before I started even messing around with making these changes.
I will revert the categories back to 'index, follow'. Some questions about this:
- Is it best to do it all at once (or will this look odd/'unnatural' somehow from Google's perspective)
- How long will it take for these pages to re-rank? They were made noindex in April, so would it be like starting again as if these were totally brand new pages?
Another SEO has recommended another approach, which is to identify the 'best' URL (from SEO point of view) and add the canonical link to the rest. Is there a way to implement/manage this easily in Magento? I can't seem to find a solution online on this.
-
That Yoast plugin is only developed up to Magento version 1.4 which is pretty old now. The good news is you can get some of this functionality out of the box now at Admin -> Configuration -> Catalog -> Search engine optimizations. If you set the use canonical meta tag link on products to yes then all product pages are given a canonical link back to a base url with no category in it. Baring a more advanced paid module or custom development, this is going to be your best bet.
Certainly change your category pages back to index, follow. Depending on your setup and how many common categories/products you have any duplicate content issue you have would usually be on a product more than a category level anyway. For category pages look at getting some good descriptions and other unique content on them. Check out this video for more details.
-
Change them all back to INDEX, FOLLOW and use Canonical plugin by yoast.
Canonical URL's for Magento • Yoast (sorry if links not allowed)
Some products on our site appear in six categories and we have no issues with duplicate content whatsoever using the above.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best Practices For Angular Single Page Applications & Progressive Web Apps
Hi Moz Community, Is there a proper way to do SPA (client side rendered) and PWA without having a negative impact on SEO? Our dev team is currently trying to covert most of our pages to Angular single page application client side rendered. I told them we should use a prerendering service for users that have JS disabled or use server side rendering instead since this would ensure that most web crawlers would be able to render and index all the content on our pages even with all the heavy JS use. Is there an even better way to do this or some best practices? In terms of the PWA that they want to add along with changing the pages to SPA, I told them this is pretty much separate from SPA's because they are not dependent. Adding a manifest and service worker to our site would just be an enhancement. Also, if we do complete PWA with JS for populating content/data within the shell, meaning not just the header and footer, making the body a template with dynamic JS as well would that effect our SEO in any way, any best practices here as well? Thanks!
Technical SEO | | znotes0 -
Best way to handle URLs of the to-be-translated pages on a multilingual site
Dear Moz community, I have a multilingual site and there are pages with content that is supposed to be translated but for now is English only. The structure of the site is such that different languages have their virtual subdirs: domain.com/en/page1.html for English, domain.com/fr/page1.html for French and so on. Obviously, if the page1.html is not translated, the URLs point to the same content and I get warnings about duplicate content. I see two ways to handle this situation: Break the naming scheme and link to original English pages, i.e. instead of domain.com/fr/index.html linking to domain.com/fr/page1.html link to domain.com/en/page.html Leave the naming scheme intact and set up a 301 redirect so that /fr/page1.html redirects to /en/page1.html Is there any difference for the two methods from the SEO standpoint? Thanks.
Technical SEO | | Lomar0 -
Representing categories on my site
My site serves a consumer-focused industry that has about 15-20 well recognized categories, which act as a pretty obvious way to segment our content. Each category supports it's own page (with some useful content) and a series of articles relevant to that category. In short, the categories are pretty focal to what we do. I am moving from DNN to WordPress as my CMS/blog. I am taking the opportunity to review and fix SEO-related issues as I migrate. One such area is my URL structure. On my existing site (on DNN), I have the following types of pages for each topic: / <topic>- this is essentially the landing page for the topic and links to articles</topic> /<topic>/articles/ <article-name>- topics have 3-15 articles with this URL structure</article-name></topic> With WordPress, I am considering moving to articles being under the root. So, an article on (making this up) how to make a widget would be under /how-to-make-a-widget, instead of /<widgets>/article/how-to-make-a-widget I will be using WordPress categories to reflect the topics taxonomy, so I can flag my articles using standard WordPress concepts.</widgets> Anyway, I'm trying to get my head around whether it makes sense to "flatten" my URL structure such that the URLs for each article no longer include the topic (the article page will link to the topic page though). Thoughts?
Technical SEO | | MarkWill1 -
Website Migration Query
We are going to migrate our site but we cannot do this gradually, so before we complete the whole migration, we were thinking of launching the new site on a sub-domain and gradually redirect traffic to the sub-domain, starting with 10%, moving up steadily so that we then migrate to the new site within four/five weeks. The new site will have a new URL structure on the same domain, with a complete re-design and the IP address will be changing as well, even though the server geographical location will remain the same. a) Should we noindex the new sub-domain while the new site is on trial? b) Are there any other issues we should look out for? Thanks in Advance 🙂
Technical SEO | | seoec0 -
Best Google Practice for Hacked SIte: Shift Servers/IP or Disavow?
Hi - Over the past few months, I've identified multiple sites which are linking into my site and creating fake pages (below is an example and there's over 500K+ of similar links from various sites}. I've attempted to contact the hosting companies, etc. with little success. Was wondering if my best course of action might be at this point: A) which servers (or IP address). B) Use the Google Disavow tool? C) both. example: { http://aryafar.com/crossings/200-krsn-team-part19.html } Thanks!!
Technical SEO | | hhdentist0 -
Help us define a category/product structure please
Hi, Apologies in advance for the long winded question... we need some guidance with our category/product/options structure in our shop. We primarily sell car parts and lots of our parts have multiple fitments for what is basically the same part. Some ranges can have 1,000s of products. We can't work out what is an appropriate level of information and granularity for our product structure.We recognise the importance of having fitments and specific terms in the product title and URL, but we also know that having loads of almost identical product pages is a definite negative and fragments our SEO potential. But where's the happy medium? For example, let's say we have a specific brand of brake pad (we'll call it Brako) with 4 different product-models (Super1, Super2, Super3, Super4), each fits 100 different cars, which are made by 10 different manufacturers. We have a few different ways of presenting/splitting up these 400 simple products: (ignore the URLs here, this is just to illustrate the browsing structure & likely product page titles) 1 category for the Brake Brand with 400 product pages inside, 1 product page for each specific combination of brake product-model and car-fitment. /Brako/Brako-Super1-brakes_BMW-M3.html 1 category, 400 product pages, 0 choices on each product page. 1 category for the Brake Brand with 40 products inside, 1 product for each specific combination of brake product-model and car-manufacturer. Each product page would then let you choose from a dropdown which of the 10 specific cars you had. /Brako/Brako-Super1-brakes_BMW.html 1 category, 40 product pages, 10 choices on each product page. 1 category for the Brake Brand with 4 sub-categories inside for the brake product-models with 100 products inside each, 1 product for each specific combination of car-fitment. /Brako/Brako-Super1-brakes/Brako-Super1-brakes_BMW-M3.html 1 category, 4 sub-categories, 40 product pages, 10 choices on the product page. 1 category for the Brake Brand with 4 sub-categories inside for the brake product-models, with 10 products inside each.1 product for each specific combination of brake product-model and car-manufacturer. Each product page would then let you choose from a dropdown which of the 10 specific cars you had. /Brako/Brako-Super1-brakes/brakebrand-Super1-brakes_BMW.html 1 category, 4 sub-categories, 40 product pages, 10 choices on each product page. 1 category for the Brake Brand with 4 products inside, 1 product for each brake product-model. Each product page would then let you choose from 2 dropdowns, each with 10 options: one for car manufacturer, the next for car model. /Brako/Brako-Super1-brakes.html 1 category, 4 product pages, 100 (10x10) choices on each product page. 1 product page containing options to choose all 400 Brako products using 3 drop down boxes: Car Manufacturer, Car Model and Product-Model /Brako/Brako-brakes.html 1 category, 1 product page, 100 (10x10) choices on each product page. Or we could mix it up and split the sub-categories by manufacturer: 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with 40 products inside each), 1 product page for each specific variation of car-fitment and product-model. /Brako/Brako-brakes-BMW/Brako-Super1-brakes_BMW-M3.html 1 category, 10 sub-categories, 40 product pages, 0 choices on the product page. 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with 10 products inside each), 1 product page for each specific variation of car-fitment. Drop dowjn box on the product page lets you choose product-model (Super1-4) /Brako/Brako-brakes-BMW/Brako-brakes_BMW-M3.html 1 category, 10 sub-categories, 10 product pages, 4 choices on the product page. 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with products inside each), 1 product page for each specific variation of product-model. /Brako/Brako-brakes-BMW/Brako-Super1-brakes_BMW.html 1 category, 10 sub-categories, 4 product pages, 10 choices on the product page. Obviously, option 1) is going to be the best search match for someone searching for 'BMW M3 Brako Super1 brakes' but that page will have almost identical content to 100 other pages and very similar content to a further 300 pages, which takes it's quality ranking down a lot. At the other end of the scale of complexity is option 5) which concentrates all search potential for the Brako Super1 down to a single page, which can be well written and have great content, but wouldn't have a match in the title, url or product name for anyone searching for 'BMW M3 Brako Super1 brakes'. 'BMW M3' would be mentioned in the page, but only once in a drop-down along with 100 other cars and possibly once in the content if there's something noteworthy about that application. So which option would you go for and why?
Technical SEO | | DWJames0 -
Multi- language URL best practices
we have two different content perlanguage (Fr. EN )) they are not Duplicated and they are completly different. what is better for the URL a language sub domain or a folder fr.mycompany.com or mycompany.com/fr/
Technical SEO | | omarfk0 -
Best practices for temporary articles
Hello, I would like to have expert inputs about the best way to manage temporary content? In my case, I've a page (ex : mydomain.com/agenda) where I have listing of temporary article, with a lifetime of 1 month to 6 months for some of them. My articles also have a specific url like for ex : mydomain.com/agenda/12-02-2011/thenameofmyarticle/ As you can guess, I got hundreds of 404 😞 I'm already using canonical tag, should I use a in the listing page? I'm a bit lost here..
Technical SEO | | Alexandre_0