This looks really nice. I have been working on something that might perhaps be of interest to you.

https://github.com/canselcik/libremarkable

I would love it if someone built a terminal emulator using it. All the pieces needed to achieve that is already in place.