We've been using PaX/Grsecurity on Debian( as server) and Linux Mint( as Desktop) for a while. It's working perfect fine until now. You can also tweak the reproducible builds as well:
https://github.com/hardenedlinux/grsecurity-reproducible-bui...
As exmaple of Linux Mint: https://hardenedlinux.github.io/system-security/2016/01/10/h...