A golang library is cool, but it doesn't give you a working ssh-agent.

I started working on one few years ago: https://github.com/Foxboron/ssh-tpm-agent