The information is lost in the sense that it's in the original, and not in the lossy version.
Whether or not you can hear it, the information is gone.
Whether or not you can hear it, the information is gone.
It may not be pertinent information in the case of music, but it's definitely information.
So yes - you can hear it's gone.
And if you look at a spectrograph, you can see it's gone, too.