I hope they don't invent a GPLv4 where nobody is allowed to use any code, period, then promptly switch all code under CLAs to it.
The more realistic risk of a CLA on GPL'ed code is that the person in control would switch it to a more permissive license without the copyleft restrictions of the GPL. That would actually have a negative impact that others can't mitigate by forking (although with a fork you could of course again make any new code added to the project the original license again).
But in seriousness, you are completely correct, and I agree with you.