Then there's the fact that you have to use an exchange to buy the coins in the first place and... let's just say bitcoin exchanges aren't exactly known as secure financial institutions. It seems a large bitcoin exchange is hacked and shuts down just about weekly:
Just hours ago: Cavritex, Canada's largest bitcoin exchange, announced that it was hacked and will shut down
4 days ago: BTER of China was hacked and lost $1.75m
Last week: Exco.in was hacked, apparently lost all customer-held coins, and shut down
Last week: Hong Kong's MyCoin died and was apparently a ponzi scheme that had $387
And that's not even counting the abrupt closures of other exchanges telling users to get their funds out ASAP or lose them.