fp16 saves a lot of memory and is worth doing. I've not had trouble fine tuning all these models with fp16.