The scenario you lay out does worry me, but is that not also an argument against strong regulations of AI to minimize the chance of AI only being available to authoritarians? These tools can be weapons in a tyrant's hands, so we should be sure to arm the citizenry?
IOW, is it not still an argument for the accelerationist side and against the caution side, even if it's not driven by optimism?