If thousands of people were dying of vaccine-preventable diseases I may reconsider my stance, but we are currently nowhere close to justifying crossing that line.
IMHO it's a self-correcting problem. If more people do start dying of these diseases some of the holdouts will get the vaccines.