I implemented the canonical tag last year in a similar situation and yes, it's on the original page as well. No issues. Look at eBay.com, they also have canonical tags on all pages including the original page.
I have not seen/encountered any issues. Now when I go check the cache for http://www.example.com/duplicate-url-3.html which has a canonical tag referring to the original-url, Google shows me the canonical URL. The duplicate pages literally disappear from the SERPS, because essentially its like a 301 redirect.