May be you put a lot more stress to finish up things before you leave on vacation. And that extra stress causes a decrease in immunity leading to sickness.