I think his point was that if you're seeking out all the pairs when you curl them together, you're still spending unnecessary time and effort matching socks, just ahead of time instead of in the moment when you need socks
Why not do a O(1) Pair folloed by an O(1) Search.
Finally, my graduate-level algorithms class comes in handy in real life.