Fingerprinting files would be the least of my concerns. When you plug a USB stick, you potentially plug a keyboard and handover control of your computer to the stick.
Most computers in various places like hospitals, veterinarians, shops, gyms and more all have exposed USB ports where it'd be trivial to plug something in when the clerk/assistant is looking the other way, just as another example.