He's referencing the common conservative notion that "too much" empathy for certain groups (in this case animals) is at the detriment to ourselves... somehow. This, of course, makes no sense when you look back at the long historical strides taken with animal rights in just western societies. You'll find very old philosophical vegetarian and vegan thoughts in other non-western societies.