But the US had already destroyed multiple Japanese cities through firebombing and killed ~900k civilians. How would the threat to destroy one of the few surviving cities left have any creditability at that point?
If you mean something like, "why would the threat to wipe out a city have an impact?"...I mean, clearly it did, because it led very quickly to surrender.