$50 sure. I don't think you could make a phone that could do what you need for that much though.
Something with just a little more capability than a "dumb" phone or feature-phone but with a more comfortable interface and 7 days battery life would be able to capture the market. Let's say, one builds "visual voicemail" and add some sort of more user-friendly banking front end which still uses the current SMS channels. Combine that with light web browsing and something like Wikipedia and Twitter/Facebook, and you'd have it.