If you're holding your breath, which a naive swimmer likely is, then it's perfectly possible to rupture parts of your throat when the pressure differential grows too large. I'm not sure if that'd be fatal or not, but it'd definitely be dangerous.

The pressure differential, in this case, was three times that between normal pressure and vacuum.