The point is you are cutting down the rainforest anyway. Most dairy is produced on factory farms that feed their cattle soy and corn and other monocultures.
Soybeans and corn don't replace rainforest. Palm oil does. No?
Deforestation of the rainforest is also driven by soy cultures and grazing. This is why my comment was not a "I just care about emission" thing as you were assuming.