I got into software engineering because I like solving problems, but also because I love solving problems with really smart people. Turns out that it feels really good to do that in person!
Coffee breaks, lunch outings, being able to stop by someone's desk and shoot the shit or see what they're working on -- I've realized that these things are not only enjoyable for me, but critical for both the actual quality of my work and my motivation to do it. Not to mention any kind of whiteboarding / collaborative discussion, which I think is pretty obviously nicer in person.
So far, nothing I have tried remotely gives me the same kind of satisfaction that just physically being with my work partners does. I do think there's something very deeply ingrained in me that's responsible for that, and I know it's definitely not something everyone wants or needs.