There is Pleroma, which aims to be a Mastodon-compatible platform which will run even on a Rasperry Pi: https://pleroma.social

It also separates front- and back-end, so it might come close to your „server-only“ idea.