But he's not going to live forever (thank god) and his successors might try to use GPL4 as a political wedge within the FOSS community. Put in restrictions on project governance and codes of conduct, make a violation unrelated to the software itself terminate the license, something like that. "Ethical source" didn't get anywhere but something backed with the heft of FSF might. (Given how RMS has stacked FSF with loyalists, it's probably more likely that they'd do something to punish "ethical source" than enshrine it. Both are equally corrosive in my view.)
Or it might make FSF even less relevant. We'll see.
The more realistic risk of a CLA on GPL'ed code is that the person in control would switch it to a more permissive license without the copyleft restrictions of the GPL. That would actually have a negative impact that others can't mitigate by forking (although with a fork you could of course again make any new code added to the project the original license again).
But in seriousness, you are completely correct, and I agree with you.