Try any earplugs. They will all have that effect to some extent. In earplugs I can hear lyrics of a song that bus driver listens to, while without them I could not even tell if that's music or just noise.

A minor warning: experiencing "silence" makes a lot of people uneasy - in my opinion it's just a matter of practice, but some find it so unpleasant that they would never use earplugs by choice.

If you want to spend more cash I find Senner brand my sweet spot (doesn't block that much, reasonable cost, reusable). Alpine for a bit cheaper option with wide range of "dB's", good for concerts or motorycle, single pair will last long time. Or Loops, a lot of hype for these ones (people claim it does precisely what you are looking for), but it's overpriced in my opinion, and blocks a bit too much sound for me (to use in office, home, but perfect for a bar, commute, cinema). Also doesn't work well in wind. All 3 of those brands give fairly natural music experience, especially Senner.

I write "silence", as it's never silent. You will hear many annoying things (hums, squeaks, high pitched noise, pulse, feet on the ground). This things sometimes get into your head and you can't stop thinking about them. That's also why googling people's experience with tinnitus (that usually has no physical reason - at all, or one that you can fix - and is constant) is the most depressing thing I did last couple of years - highly recommend not investigating that too far.