That's the whole point of the conversation we're ostensibly having.
To start, I think everybody should be able to do financial calculations (like compounding interest), and be able to decipher the charts they are being bombarded with every day in the media.
Other than that I guess I agree with some other posters that it is the people who figure thinks out who are often also good in maths. I am not even sure how to teach that and if traditional maths at school helps.
I don't think that means everything is fine as it is, but also that simply getting rid of subjects because people don't enjoy them may be too much.