As a candidate for a remote role, who hates to travel, this is off putting to me and I would not accept a role at your company. While it is "optional", I know how office politics work and, when you choose not to do the "optional" things, someone is thinking you aren't a team player.

I don't mind full remote -- if it's full remote. I also don't mind going in the local office (for the reasons you mentioned people like your company trip -- I feel more connected and communication walls are broken down).