Fat is calorically dense. If you're trying to lose weight, you need to be careful about eating calorically dense foods. And if you want to eat more protein to maintain muscle while losing weight, there is a zero-sum trade-off between fat and protein.