I like the idea of "it's not about LLMs" better as a starting point. For example, someone could peel off from a shared coding session, ask an LLM to try a concept, then bring that LLM chat to the group to explore (and then yes close that window and go back to face-to-face). Make more efficient use of the face-to-face time.
You could be right but I can think of numerous frustrating code jams in my past when we burned a lot of precious face-to-face time on fussy setup or other fiddly stuff.