Yes it is not so straight forward to be able to push/pull from a repository over ssh especially with multiple users etc there are a bunch of additional configs required for this
once you add multiple users, bare git stops feeling "just" pretty fast. do you need reviews/CI too, or only shared access?