I'm curious to know your site and the competitor in question.
I, like you, feel like I've been running into walls and wondering how they got in the road.
check out this thread and let me know if you think it's relevant to your situation:
http://www.seomoz.org/q/aged-sites-or-5-year-old-seo