Not entirely sure that's correct either. One could use a Hardware Security Module, such as the Thales nShield Connect[1], which will keep the private keys secure (at least in theory).
[1] http://www.thales-esecurity.com/Products/Hardware%20Security...