There is a way to train with mixed fp16/fp32 precision.