Maybe there is simply not enough medical data to properly train a 500B model.