PGP is the best option, but makes it harder for the recipient. Perhaps added security = added hassle, and there's no way around that.

Here's how to protect GDrive files: https://news.ycombinator.com/item?id=6644888