That's likely only the marginal cost of training this model, and doesn't include a lot of other costs, like the datacenters and GPUs themselves which they already had and also the staff.

If they aren't lying because they have hardware they're not supposed to have, which is also a possibility.