I think you could probably massage that answer though “well standups aren’t my favorite thing really, it’s sort of a lot of context switching and a lot of times the conversation isn’t relevant to me. But I understand it’s generally more for the managers than it is for me.”
And for the latter one
“I like a very professional, cordial, and relaxed relationship with my coworkers. I tend to do my own things on weekends which leaves me refreshed and happy to see everyone on Monday.”
It’s just a bit smoother than “the last thing I’m going to want to do is spend _more_ time with you”.
Instead of emphasizing the drain it’d be to spend more time with your coworkers, emphasize the benefits of coming back refreshed on Monday :-). They’re the same answer but one’s more positive.