The Naturalization Oath is "Renounce and abjure absolutely and entirely all allegiance and fidelity to any foreign prince, potentate, state, or sovereignty of whom or which the applicant was before a subject or citizen".
Makes no mention of giving up citizenship or passport-holding, just allegiance.