Yes, until the original project starts releasing new changes under the new license. From there, the "selfish" party would have to fork and maintain what they have on their own.
That doesn't require GPLv4 though. Anyone wanting to switch their project to the AGPL can just start releasing new versions under it. Existing code would be available as GPLv3 and the newer stuff under AGPL, same as the v4 scenario.