Interesting. I've always preferred the input source to be global rather than scoped-to-app. I can remember one input source but I can't remember for every open app, so I always know whether I have to switch.
Are you switching between English and some other Latin alphabet language? Or non-Latin?