Still much work to do but it's an interesting idea and a good demo for one day of work.
It core dumped after a few minutes and I had to close every terminal instance before being able to type again but it's OK for what it is.
When it won't crash and kill the keyboard I could use it as a clicker for PDF presentations on my Ubuntu laptop. There is already a wonderful remote for LibreOffice Impress (https://play.google.com/store/apps/details?id=org.libreoffic...) but I didn't have anything for the other presentation formats.
But we'll need at least some kind of authentication over an encrypted channel.