I am an introvert and absolutely hate group behaviors and nonsensical smalltalk around lunch time.
However I have no issue being a manager and talking to people on 1:1s or with a clean agenda and subject to discuss.
honestly im not sure how you can do well as a manager without some tolerance for that kind of thing