I believe that RBAC may be possible, though I've never tried it. However, I have used TLS client certificate to get access equivalent to LXD group as a normal user. I've tried it using lxc command and python script.