Out of ~80M hourly wage workers, only ~500k of them are paid minimum wage. Given the size of the workforce and the fact that starter jobs do exist, that's not 'so many' at all..

[1] https://www.bls.gov/opub/reports/minimum-wage/2017/home.htm