Hey man, it is an amazing idea. I have been thinking to build something similar.
I am building reading clubs for my custom library - on top of crypto tech, and in the process, I have experimented with several book reader tech. pdf.js, muPDF and some other tools, which one did you settle on?
My lib: https://datapond.earth