Depends on the situation. If you're traveling, cancelling your card while away from home is a huge setback.