If I stick my hand in water then it gets wet immediately, but doesn't wrinkle for... what, fifteen minutes? And that's warm water -- cold water (like practically all the naturally-occurring water in the world) takes a lot longer.
And then, I can dry my fingers much faster than I can un-wrinkle 'em. Surely the circumstances in which an ancestral human would:
a) Spend fifteen or twenty minutes in the water, then
b) Need to pick up something vitally life-preserving within the next few seconds
would be sufficiently rare that it probably wouldn't have been a major selection pressure?