Dairy and meat is part of a healthy diet. While not impossible to do without, health problems often develops with time. That's why most people (84%) who adopts a vegan diet at some point in their lives, returns to eating meat and dairy again. The first years on a plant diet are usually great, almost everyone feels better than ever. Then after 5-10 years many will experience a steep decline in health, both physical and mental that is resolved with returning to animal products. Of course eating too much animal products and not enough plants will also make you sick, that goes without saying.
So yes, agree very much that we should care how it is produced.