> A wide range of different listeners were not consulted and a wide range of musical styles were not tested during the development phase
Luckily, codec developers aren't totally stupid. File formats tend to be defined through their reading operation, not the writing operation.
Fraunhofer MP3, LAME and many others went way beyond the initial mp3 reference codec in terms of deciding what parts of the signal are important or not.
Synthetic tests like the "put noise in it, check if it's still evenly distributed in a frequency plot" one the article shows are misleading. I could tweak lame into recreating regular noise sufficiently, while still creating valid MP3 files.
The same input probably looks quite different when put through 8hz-mp3 or some early bladeenc (which are similar to the ISO reference codec, and _very_ unlike contemporary LAME's psychoacoustic model).
Optimizing your record studio output to any given codec version is futile for that reason, too: Do you optimize for 1998's MP3 encoding? or 2015's? or Vorbis, AAC (and which of its 2 dozen profiles?), Opus, ...?