Are you fully willing to accept the consequences of this policy? Please keep in mind that, had the Allied governments followed your principle during the Second World War, the Axis powers would have easily won.

Edit: Hell, let's just take this at the lowest levels, too: this kind of policy means everyone's medical and tax records become public, there would be no Witness Protection Program, and routine criminal justice might end up being impossible.

Let's not even go into the fact that this would prevent the government from using RSA, even for benign purposes such as authentication or something.