I think I found my own answer,
I switched the links to the tel: format and wrapped them in Schema.org markup, and that seems to be working, When I re-crawled the 404's went down and I'm not seeing them anymore. Still waiting on October 25th data dump to see if my DA goes back up.
I'm not sure which one resolved the issue though.