PDFs can already contain videos and JavaScript. But given the security problems, I consider it a feature of most non-Adobe PDF viewers to not support that.
Perhaps we should move to sandboxed webpages embedded within electron, where each paper is its own page?