I started with https://ledger-cli.org. Later built a GUI https://github.com/ananthakumaran/paisa on top of it
There is a clear separation between the cmd line tool and paisa. It should be relatively straightforward to add support for more. I will look into it later.