It depends if you count time in hours (you're mostly right) or days (you're wrong).
I have a bin of small screws and bolts which I've removed from devices. An hour spent searching for the right fit can save 1-3 days shipping time. If I'm in the middle of something, the advantage of being able to continue with whatever I'm repairing / building / doing ultimately saves hours of time in the end too. Breaking up a task each time I need a part loses focus and velocity.
What I'd really like is some machine vision system. If I remove fasteners from a laptop, I often don't know what they are. I'd like to be able to have the identified without having to look for service manuals. Ideally, it'd be attached to some way to sort too.