Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Redirecting Canonical 301s and Magento Website
-
I have an issue with a client's website where it has 3700+ pages, but roughly half of them are duplicates. Thankfully, the only difference between the original and the duplictes is the "?print" at the end of each URL (I suppose this is Magento's way of making a printable page version of the same page. I don't know, I didn't build it.)
My questions is, how can I get all the pages like this
http://www.mycompany.com/blah.html?print
to redirect to pages like this...
http://www.mycompany.com/blah.html
Also, do they NEED to be Canonical, or will a 301 redirect be sufficient.
Also, after having done this, if anybody knows, is there a way I can turn that feature off in Magento, because we're expanding our product line, and I don't want to have to keep chasing after these "?print" pages after the fact.
-
Late to this game, but just in case you're still waiting on your dev...
Magento has an automated add-on system called Magento Connect, and you can access it from your admin (unless the original installer disabled it on your account). You can just use that to install Yoast's plugin. Check out http://www.magentocommerce.com/magento-connect/canonical-url-for-magento.html
Aside from that, if you are using something after 1.4, you should have canonical built into your store (it's in the config section).
If you're not using something after 1.4, consider upgrading. It's not painless, but anything prior to 1.4.1 is pretty rough to use. I'm not surprised you've got bugs and general sadness.
-
Hehe, hey now, not all us developers are lazy
You know your system better than any of us do. My 1. and 2. are just the best-case order in which to get things done. Do what works for you and your site.
-
like I said, I will email your solution concerning the plugin to my web admin guy, but the reason why I'm kind of reticent to do that is it's more a matter of bureacracy (to be sensitive to his time constraints) rather than technical or lack of know-how. I want to get it done right, but I also want to get it done in a timely manner. But I will forward this to him. Thanks you sir.
-
I don't understand why you don't just use the rel="canonical" plugin I mentioned above... ?
-
thank you sir....I'll try to avoid the htaccess route then.
-
Yeah I guess this is the only way to go. Now I just got to get the webmaster to get around to it. (sigh)...
-
Yes to your first questions. Here's the process for each (as I see it):
1. Fix/remove the ability for system to generate ?print URL's and implement canonical tags; open beer and wait 'til search engines sort things out. Nothing more you can do here.
2. No fix to system so we still have ?print URL's. In this case, setup the 301's in your .htaccess file; however, as long as the system is still generating these ?print URLs, you will have to keep the redirects in the .htaccess in tact, permanently.
Untested:
RewriteEngine On
RewriteBase /
RewriteRule ^([^/]*).html?print$ /$1.html [L,NC,R=301]
-
I guess my question now is, just doing the htaccess route is a bad idea? in both 301s AND canonicals or just 301s? I guess I'm not looking for easy, but economical. Thanks for your responses.
-
I agree with THB on this, use rel="canonical" you simply want to say to the search engines "Hey this is the preferred URL for my content".
301's are for saying "Hey this page has permanently moved to a new page/site"
I would use the rel="canonical" plugin I posted for you above, it will automatically add the canonical tag for you, job done.
-
Yeah, I know, right. The problem is, I found this out only AFTER I bought the PRO version and mapped out the entirety of the site. Some of those ?print URLs are now indexed in the SEs. So I agree with nipping this problem in the bud (or the root, whichever one prefers), but I still need to know how to do it via the htaccess. In other words, I have to go backwards and take care of the rankings, THEN figure out how to turn it off (and I can go to the Magento forums for that).
-
So, assuming this works, can I eventually remove the ".html?print" versions of the pages after the SEs have changed the URLs in their indices?
also, I'm not getting the impression it's going to save me time on specifying different pages (it may save time, I'm not sure), but in the chance it doesn't or the plugin fails to do as advertised, what is the htaccess option for this? Because at least, in this case, I can see the immediacy in it AND you can do canonical rewrites FROM the htaccess.
My situation is, I'm not THAT advanced in wildcards to make this happen (otherwise, I'd do it myself via just trial and error until it works) AND I myself don't have access to the site (the webmaster does, whose part time) and I have a choice between "Hey, here's several (or one line) of code to put into htaccess to resolve this problem" OR "can you go through and implement this plug to do the Canonical redirects on every page, oh and by the way, please back up first."
So it's not merely JUST a technical problem or a know-how problem, it's also a bureaucratic problem that can mean the difference between getting it done in a few minutes, and it could take two weeks to make happen depending on this person's perception.
-
Just to clarify. If there is in fact no difference between the pages (as you originally stated), then please just use the canonical tag. As much as you might want to setup 301 redirects, they would not be the way to go in this case. Trust me.
Otherwise, here is what I would do, honestly: find out why the ?print is causing information to be displayed improperly in some cases. If it's accessing the same db tables using the same queries, then that shouldn't be happening. I'd fix that, and implement the canonical tags, and wait it out. That would be the easiest approach and most beneficial with the least impact to your site and any rankings.
If this is something your not capable of fixing (not sure if you're proficient with coding, etc), then you can setup 301's as a 'hack', but they should not be left in permanently as the process in which I stated just above is the best way to resolve the issue.
In order to assist you with any .htaccess markup, you'll need to provide some examples of your URL's, and whether they have any common identifiers.
-
OK - I was basing my answers on what you said, "the only difference between the original and the duplictes is the "?print" at the end of each URL"
If there is in fact different content on each page, and the ?print page is the one with the errors, then you should remove the ability for ?print pages to even be generated in the first place instead of having them constantly redirecting user/bots. Forever 301 re-directions can hurt you down the road.
Once you've removed the ability for users/bots to find and access the ?print pages, then setup the 301's and insert the canonical tags.
-
It looks like this plugin will add the rel="canonical" tag for you automatically: http://yoast.com/tools/magento/canonical/
View the source code after you have installed it to confirm it's working as expected.
-
I was answering this Kjay's response while this one was coming down the pipeline. I get you on the fact if they were TRULY identical, but the reason I wanted to do the 301s is because more than likely, the Magento engine is faulty, and I've found situaitons where the prices are different between the two versions, or the images and text haven't been updated, etc. etc., hence, the need for a 301
-
I guess my question is, if I use JUST the canonical, then the SEs will get around to changing the address, but will still go to the "?print" pages until that time.
Also, the Magento help aide on that said I had to do it with EACH individual page. It's going to be especially time-consuming to have to go back out into the admin, go back into the admin, and check to see EVERY time the page that I'm canonizing is the right html version. I think this is where accessing the htaccess will save me a bunch of time (I still have to change the title tags on the remaining original 1500 pages, as well as find out from the Magento site, to access the H1 tags in the templates).
If I use the basic 301 redirect, I get the benefit of the immediate redirect, but I fail to see the downside of having to "endure" the 301 redirect other than additional rules for the browser to access the server. I eventually want to get RID of these "?print" pages because I'm getting the feeling that prices won't update as reliably on the ".html?print" version of the pages, update images (which we HAVE had trouble with in the past) etc. etc. And there's also the possibility that people may still access those ?print pages even if I did just do a canonical. It's just better to admin and SEO 1500+ pages as opposed to 1500+ pages and their duplicates.
I guess, what I'm looking for is, more than likely, the syntax command that's going to include a wildcard function to accomodate everything between "http://www.mycompany.com/" and ".html?print" or ".html". What would that look like?
-
Agreed
-
Ya, this is what I was talking about. Just a standard canonical html tag inserted into the framework.
That will clear everything up for you (might take a wee bit, but Google will recognize it right away).
No need for .htaccess whatsoever since the content is identical. If the content were different, ie. the ?print page showed a completely different style format, then sure, setup some 301's to get the user's to the right page. But not needed for your situation.
-
I would just add:
rel="canonical" href="http://www.mycompany.com/blah.html" />
No need to add 301's.
This might be useful it's Magento specific: http://www.magentocommerce.com/wiki/adding_canonical_url_to_cms_pages
-
Okay, so if I were in the htaccess file, what would it look like?
would it be a Query string rewrite?
RewriteEngine On
_ RewriteBase /_
RewriteCond %{QUERY_STRING} ^(*)$
RewriteRule ^()html?print$ http://www.mycompany.com/()html$ [R=301]
or just a straight one line redirect
Redirect 301 /()html?print http://www.mycompany.com/().html
-
Canonical will suffice as it is basically a 301 anyways. Cleaner too as there is no actual redirect for the user, or bot, to endure.
You can also set it up in Google Webmaster Tools under 'Site Configuration > URL Parameters' to ignore that parameter; however, using the canonical tag will more than suffice in this case.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why has my website been removed from Bing?
I have a website that has recently been removed from Bing's index, but can't figure out why. The website isn't new, and it is indexed just fine on Google. These are the steps I've tried: The website is verified in Bing Webmaster Tools and successfully submitted the sitemap. I tested the URL to ensure that Bingbot is allowed to crawl the site I submitted URLs to Bing via the URL Submission tool There isn't a "noindex" on the site preventing it from being indexed When I do a URL Inspection, an error message comes up saying "The inspected URL is known to Bing but has some issues which are preventing us from serving it to our users. We recommend you to follow Bing Webmaster Guidelines." I contacted Bing to ask whether the website was removed in error, but received a reply that the website doesn't comply with Bing's quality guidelines, but they wouldn't go into detail as to which guidelines the website isn't meeting. The website URL is https://www.pardeehospital.org. Can anyone offer any advice or insight as to why Bing won't index our site? Thank you!
Intermediate & Advanced SEO | | lindsey.steinkamp0 -
If my website uses CDN does thousands of 301 redirect can harm the website performance?
Hi, If my website uses CDN does thousands of 301 redirect can harm the website performance? Thanks Roy
Intermediate & Advanced SEO | | kadut1 -
Switching from HTTP to HTTPS: 301 redirect or keep both & rel canonical?
Hey Mozzers, I'll be moving several sites from HTTP to HTTPS in the coming weeks (same brand, multiple ccTLDs). We'll start on a low traffic site and test it for 2-4 weeks to see the impact before rolling out across all 8 sites. Ideally, I'd like to simply 301 redirect the HTTP version page to the HTTPS version of the page (to get that potential SEO rankings boost). However, I'm concerned about the potential drop in rankings, links and traffic. I'm thinking of alternative ways and so instead of the 301 redirect approach, I would keep both sites live and accessible, and then add rel canonical on the HTTPS pages to point towards HTTP so that Google keeps the current pages/ links/ indexed as they are today (in this case, HTTPS is more UX than for SEO). Has anyone tried the rel canonical approach, and if so, what were the results? Do you recommend it? Also, for those who have implemented HTTPS, how long did it take for Google to index those pages over the older HTTP pages?
Intermediate & Advanced SEO | | Steven_Macdonald0 -
Website Redesign, 301 Redirects, and Link Juice
I want to change my client’s ecommerce site to Shopify. The only problem is that Shopify doesn’t let you customize domains. I plan to: keep each page’s content exactly the same keep the same domain name 301 redirect all of the pages to their new url The ONLY thing that will change is each page’s url. Again, each page will have the exact same content. The only source of traffic to this site is via Google organic search and sales depend on the traffic. There are about 10 pages that have excellent link juice, 20 pages that have medium link juice, and the rest is small link juice. Many of our links that have significant link juice are on message boards written by people that like our product. I plan to change these urls and 301 redirect them to their new urls. I’ve read tons of pages online about this topic. Some people that say it won’t effect link juice at all, some say it will might effect link juice temporarily, and others are uncertain. Most answers tend to be “You should be good. You might lose some traffic temporarily. You might want to switch some of your urls to the new structure to see how it affects it first.” Here’s my question: 1) Has anyone ever done changed a url structure for an existing website with link juice? What were your results and do you have a definitive answer on the topic? 2) How much link juice (if any) will be lost if I keep all of the exact content the same but only change each page’s url? 3) If link juice is temporarily lost and then regained, how long will it be temporarily lost? 1 week? 1 month? 6 months? Thanks.
Intermediate & Advanced SEO | | kirbyf0 -
How do you 301 redirect URLs with a hashbang (#!) format? We just lost a ton of pagerank because we thought javascript redirect was the only way! But other sites have been able to do this – examples and details inside
Hi Moz, Here's more info on our problem, and thanks for reading! We’re trying to Create 301 redirects for 44 pages on site.com. We’re having trouble 301 redirecting these pages, possibly because they are AJAX and have hashbangs in the URLs. These are locations pages. The old locations URLs are in the following format: www.site.com/locations/#!new-york and the new URLs that we want to redirect to are in this format: www.site.com/locations/new-york We have not been able to create these redirects using Yoast WordPress SEO plugin v.1.5.3.2. The CMS is WordPress version 3.9.1 The reason we want to 301 redirect these pages is because we have created new pages to replace them, and we want to pass pagerank from the old pages to the new. A 301 redirect is the ideal way to pass pagerank. Examples of pages that are able to 301 redirect hashbang URLs include http://www.sherrilltree.com/Saddles#!Saddles and https://twitter.com/#!RobOusbey.
Intermediate & Advanced SEO | | DA20130 -
301s being indexed
A client website was moved about six months ago to a new domain. At the time of the move, 301 redirects were setup from the pages on the old domain to point to the same page on the new domain. New pages were setup on the old domain for a different purpose. Now almost six months later when I do a query in google on the old domain like site:example.com 80% of the pages returned are 301 redirects to the new domain. I would have expected this to go away by now. I tried removing these URLs in webmaster tools but the removal requests expire and the URLs come back. Is this something we should be concerned with?
Intermediate & Advanced SEO | | IrvCo_Interactive0 -
How important is the optional <priority>tag in an XML sitemap of your website? Can this help search engines understand the hierarchy of a website?</priority>
Can the <priority>tag be used to tell search engines the hierarchy of a site or should it be used to let search engines know which priority to we want pages to be indexed in?</priority>
Intermediate & Advanced SEO | | mycity4kids0 -
301 vs 410 redirect: What to use when removing a URL from the website
We are in the process of detemining how to handle URLs that are completely removed from our website? Think of these as listings that have an expiration date (i.e. http://www.noodle.org/test-prep/tphU3/sat-group-course). What is the best practice for removing these listings (assuming not many people are linking to them externally). 301 to a general page (i.e. http://www.noodle.org/search/test-prep) Do nothing and leave them up but remove from the site map (as they are no longer useful from a user perspective) return a 404 or 410?
Intermediate & Advanced SEO | | abargmann0