As much as I like to Encrypt All The Things™, unless you're concerned about somebody stealing the physical device, you don't need to encrypt it.
It should be possible to set up an encrypted directory with something like FUSE (though afaik FUSE doesn't run on the reMarkable), though. https://github.com/evidlo/remarkable_entware lets you install fstools.