FP16 for calculating all activations. Some data is stored as FP8 at rest.