Yes. The US used to be quite strict about this. It still is if you acquire US citizenship by naturalization.
"I hereby declare, on oath, that I absolutely and entirely renounce and abjure all allegiance and fidelity to any foreign prince, potentate, state, or sovereignty, of whom or which I have heretofore been a subject or citizen"
The deal for people who are already US citizens is easier.