There is only so much labor we have as society. We need to make choices as to what we do. If everybody was willing we could dedicate society to just math. People can sleep under their desk at work, eat the mass produced cafeteria food, never watch sports, just work eat sleep. A lot of mathematicians could be funded with the leftover money (remember they are living the same life so their cost of living is tiny - more than half our population could produce more theorems).
The above is obviously Reductio ad Absurdum. However it brings out the point: we as a society have already decided math isn't the most valuable thing. We are already drawing limits, the only question is where.