Is it the Diamond Rio PMP 300 you’re thinking of?
https://en.m.wikipedia.org/wiki/Rio_PMP300
That thing was awesome and really blew people away with how small modern electronics could be. Re-encoding mp3 files at 16kpbs (so you could fit a decent amount on the 32MB) made the music sound like crap but we didn’t care.