Problem is, when you give workers a choice to come into the office, it becomes a game theory problem that ultimately results in no one coming in.
"Why come to the office if none of my team members are there?"
If you strongly believe the office is valuable, surly there are others who agree with you. Those people will be there. Everyone else can work from home.
Game theory shows that systems involving multiple people making decisions without coordination can very easily settle into subptimal equilibriums.
And that's almost certainly gonna be the case here.