If you were to digitally record the output of a record player and play it back, there would be no discernible difference.
That’s probably true, but nobody does that.
I also have some which are not available digitally otherwise (or only in remixed or remastered versions)
Vinyl sounds blatantly different due to analog distortion in the vinyl mastering and playback mechanisms. The distortion, frequency response, dynamic range, are all significantly different. You must be practically deaf to not hear the difference between vinyl and CD quality.
CDs are stereo 16-bit @ 44kHz PCM with an upper limit of about 80 minutes. That's 80 * 60 * 2 * 2 * 44100 = 846,720,000 bytes = ~807 MiB / 80 minutes.
I can get a 1 TiB thumb drive and put 1200 CD audio ISO images on it. Of course, that's pointless because one can rip tracks as FLAC to get lossless compression.
Blu-Ray audio has options including 24-bit PCM @ 192 kHz. 2 channel stereo is 60 * 60 * 2 * 3 * 192000 / hr = 4,147,200,000 bytes/hr = ~4 GiB/hr. Even with FLAC, I wouldn't expect more than 500 albums per thumb drive.