Yes, you can just use one at a time and it'll route audio input/output accordingly. They charge pretty fast in the case, too, so you could go a long time switching between each one at a time.
If you’re playing music or podcasts, removing one from the ear will pause the playback by default, and you have to tap play again. But with phone calls, the call just continues if you remove one for charging.