> The SSH agent isn't divulging the keys. The OP is decrypting the keys from the underlying storage.

But can't just any program do that as soon as you're logged in? (Since your login password basically unlocks the DP-API which is protected at rest.)