The problem is a little bit more than people are paying too much for a worthless degree. It's that they are being given a loan that is backed by the US Government to get that worthless degree.
If the government removes the backing and allows the free market to give loans and set interest rates, suddenly you'll see that the lowest rates will be for STEM degrees, and those who want to study music theory, art therapy, English literature, are going to get loans for school.
However, that defeats the entire narrative of "everybody should go to school and everybody should learn whatever they want."