If you could build a physical book that had e-reader pages (and took no power to read), that would solve some of the issue(s) both have.

Its nice that you have a stack of books, but I also don't really want a stack of books even in tiny form factor. I want, maybe one or two books at a time, and I don't want to worry about them getting stolen/dropped/spilled on/not being charged/need an account to login to. I also don't want to search on a tiny bad UI for which book it is I actually want to read.

So for me e-readers remain a non-starter. Give me a real book any day. IFF I want to search it I have a tablet if I'm doing work or taking a note on it. And other than leaving it behind, I'm not afraid of someone swiping it when I order another coffee.