Is it possible to use a security token with this? My last search was not fruitful. :(
Then you can choose to either type it in every time you unlock a password or cache it for your session (depends on how important security is for you).
Personally I cache it for my session. This way I only need to type in my pass phrase once when I power on the machine.
The best part about the pass utility is that it piggy backs off GPG for its encryption mechanism.
A quick Google shows this: https://github.com/drduh/YubiKey-Guide
I didn't read everything but it seems pretty comprehensive.