Typically offsites (for me, as a senior level engineer) happen during the work week, not during a weekend. I feel that people are more productive and creative at offsites during regular work hours because they're not thinking about what they could be doing instead (like going on a camping trip with friends, for example).

I agree that my weekends are mine, and there needs to be a work/life balance no matter what position you are in.