Try playing brown noise through a subwoofer (a good Bluetooth speaker, not your phone's speaker), the low frequencies can block bassy noises (footsteps, TV, etc) so your sleep isn't interrupted by a sudden sound from above.
I'm sure tjalfi's downstairs neighbors will love that.
Have you spoken to your neighbor about this?
I haven't. I am a fairly light sleeper and I doubt the noise is intentional.