That's wrong. Insiders can leak the private key, or hackers can take it.
Or it gets left on a USB key in a taxi
Or it gets left on an un-scrubbed laptop that's put up for government auction.
Or any of the other which-ways that humans get around policy limitations that don't have technical barriers, or socially-engineered to get around the technical barriers.
The more important the key, the more sought after it will be by hackers, especially one which could theoretically decrypt an entire countries communications. It's only a matter of time.