Don't count only links, analyze each link, from what type of site it is coming from, the linking domain's authority and spams core. Also check that the linking site is having organic traffic or not. Disavow links that are coming from adu*t sites. Publish content regularly, all done. Similarly happened with my site https://packagekarlo.pk which is a internet and telecom site, I was very disappointed , but I did the same as I told, and now its improving day by day.
