For me, it depends on how familiar I am with the song—if I've heard it a thousand times, the lyrics fade into the background for me. But if it's a new song, for example, my concentration plummets.
I have the (somewhat) opposite problem of needing to concentrate to hear the lyrics of a song. By default the lyrics fade into the background and I only notice the beat and/or musical instruments.