Seems the direnv plugin aims to resolve, but I struggled to get it working. 200ms for hasn't been a huge issue (yet), but not having the proper paths set up has been. Using shims isn't the greats experience (something direnv plugin also aims to address).