I think OP wants it to be an always-on device. The last sentence in the post is

> Nokia N900 enjoying its new life as an online radio device using Open Media Player.

But I agree with your sentiment. Using supercaps seems overengineered to me if the device is connected anyway.