Lockbox: secure secrets for your rails model using public key crypto.
mashd.cc
mashd.cc
I may not understand your application correctly, but it's unclear why you're even using public key crypto. It appears that you must type a passphrase to access both a public and private key that live on the same server. Why not just use a symmetric key?
Cautionary advice about rolling your own crypto: http://www.youtube.com/watch?v=ySQl0NhW1J0