What analytics tool are you using? I know that both Google Analytics and SiteCatalyst have functions where you can make a note of changes - make sure you've recorded the date of the change so you can compare back and forth and as time goes on, remember exactly when the switch happened.
I would also run some comparison reports for equal amounts of time before and after the switch - things like your most popular pages by organic traffic, home page visits, etc. That will show you right away if an important page has stopped doing well.
In the Moz tool, tracking rankings before and after is definitely a good thing to do. You should also dig in and see which pages are ranking for your target terms before and after the switch to make sure it's still the page you want ranking for the keyword you want.
Lastly, don't forget that your site switch didn't occur in a vacuum. Take into account factors such as seasonality that could also be impacting your traffic post-switch.