The live prongs are insulated to such a length you should not be able to touch any conductive part before the plug is no longer making electrical contact with the socket.
It's likely you got a small zap from a filtering capacitor inside the device that had not yet discharged.