For me, I use Spacebar as a leader key in Neovim, so I think they would conflict.
Does it ever create issues for you if you need to type the backtick in the terminal?
I found that Ctrl-A does a great job: it is conveniently located in relation to other keys that I need to interact with after I activate the prefix, and is in general easy to use.