The smartest people don't get that choice. Oppenheimer, Teller and Ulam were all ignored in matters of policy, the Manhattan Project was not designed to integrate their political feedback. Conversely, the scientists at Peenemünde never got to question the effectiveness of V-1 bombs with a CEP measured in miles. Their participation in policy was deliberately severed, ultimately to the detriment of the Wehrmacht.
When you start seeing technologies that affront humanity - warrantless surveillance, civilian terror weapons, chemical/biological agents - that's when normal people step out. No amount of sanewashing will fix the underlying administrative issue, it only exacerbates the underlying moral dilemma.