Some of those costs are hard to quantify scientifically or intangible e.g. restrictions on individual freedom, and even the scientifically quantifiable data may have large variability so you have to take an opionated position. Different cultures will obviously take different positions due to different weights they place on risks and values.
Therefore, at this point you leave the realm of science and enter the realm of politics. For whatever reason, people like to pretend it's entirely a scientific discussion but it's not.