By that metric a complete ban on LLM’s might be on the table, which I don’t think is something you’re advocating for here.
That’s dangerous ground because of how you can arbitrarily change weights of different metrics. If the goal is the “overall benefit of humanity” then that’s what’s important not metrics.
How do you propose to asses “overall benefit to humanity” with metrics?
I'm not trying to discount the qualitative approach, but I think it's not impossibly hard to find metrics we can associate with "overall benefit to humanity" from a quantitative viewpoint.
One would hope for the slightly higher ambition of metrics that are causally connected to "overall benefit of humanity", settling for merely correlated has that unpleasant risk of the association breaking as you try to optimise.
This matters due to the difference between a hypothetical perfect analysis covering every possibility and one than can actually take place in the real world.
Seems oddly sour grapes.