While we're at it, why not shove our financial passwords etc. into our HTTP headers for every website we visit?

That would be awfully convenient. You'd never lose them or need to deal with another native application. Just open any web page that echoes all HTTP headers and then check your account balance.

Or maybe having a separation of concerns for different applications in a general purpose computer is worth the friction.