I have a friend who got a really tiny (like, fits in your wallet tiny) cell phone from China. Worked fine when he put the SIM card in, and the audio quality was really solid.
I was trying to avoid “things you buy from resellers who ordered 5000 of them from Shenzhen at half a dollar a pop and then marked them up 2000%” but honestly that’s also a great option in a pinch.