I would like to discuss coming into the office more

> I feel like I'm in an awkward in between situation at the office. Enough teams have people that come in everyday that I end up doing a lot of communication work.

This means that you haven't structured your communications in a remote-friendly manner. This is a solved problem, but it requires you to do the work of restructuring your communication practices.

> when we do all get into the office all at the same time I tend to chat way too much. I think that the problem will stop being as big of a problem if people came into the office more

In other words: "I'll stop doing this annoying thing if you'll just do everything my way."

> want to talk to people generally because I'm a little puppy dog and I felt so alone.

This is the actual crux of the problem. The solution is to go work for a company that can satisfy your emotional needs, rather than imposing them upon your current co-workers.