You can find many music players from second-hand markets, still in good conditions. I purchased one for 15 dollars from eBay (it used to cost a hundred dollars) and installed Rockbox, now it can decode sounds in all encodings, including Vorbis and Opus, and I can even use it as a TOTP authentication token or Morse Code keyboard for your computer (I don't recommend one to use it as such tools, it's not good at doing these jobs, but I tried because I could... If you are a hardcore programmer, you can even try programming a 3D demoscene on the player!)

If you insist on buying a new one, the Hi-Fi community still makes audio-only music players as well.