One of the other concerns (apart from safety) is the job displacement aspect - if AI displaces too many workers too fast, that could spark a worldwide conflict (some speculate that similar automation pushes laid the groundwork for WWI and WWII).
So there is a benefit beyond just AGI safety.