Definitely use ASDF for managing it. I’ve started using it for Node too and I quite like it, even though I was pretty hesitant to start using yet another package manager.
Direnv is generally a good idea once your project reaches a certain level of complexity