Any plans to support rootless operation? That's my favorite feature of podman that LXD currently lacks. I believe the underlying LXC tooling already supports managing containers as a non-root user. Currently LXD requires either sudo or membership in the "LXD" group, which is essentially equivalent to having root privileges.
I believe that RBAC may be possible, though I've never tried it. However, I have used TLS client certificate to get access equivalent to LXD group as a normal user. I've tried it using lxc command and python script.
LXD now has a lxd-user process which allows for automated restricted project generation providing a safe LXD environnement for non-admin users.