Because the bit thats import is your context (ie email, credit card, privileged data), not the place where you do the execution.
Having a separate machine thats isolated is all well and good, but that doesn't protect you from someone convincing your openclaw to give them your credit card.