Of course, you need to deal with fast changes in pressure during the short journey towards the surface (protect your eardrums, lungs etc) and you may get decompression sickness depending on the dive time and avg depth at the moment of emergency, but hey, at least you're alive to deal with all those problems!
*: Generally, a scuba diver takes additional weights to counter the positive buoyancy effect of wetsuits, fat etc. These are mounted on belts or similar accessories that are designed to be very easy to get rid of in case of emergency.