It's way past time we accepted that all current operating systems are single user environments. Any access to the system means full access to the system.
Just allow them to do anything, but isolate the environments such that it doesn't matter if one is compromised, because there is nothing to compromise other than the application itself.
Strongly recommended if you're willing to live without GPU support.