Is our only recourse downloading the entire block-chain to keep our wallets stored offline? Or do I have some misunderstanding? I just really like the convenience of services like coinbase.
Edit: here is one way to do it https://en.bitcoin.it/wiki/How_to_set_up_a_secure_offline_sa...
At a recent meetup there was a presentation recommending Electrum with HD wallets instead. That would mean you really would only need to memorize a passphrase, all the keys would be generated from that so no backup necessary. Personally I am not yet 100% sure HD wallets are safe, need to look into it.
But a thin wallet like Electrum is probably your best bet.