In fact it's an easier sell, isn't it? You're not adopting a language of one of the 4 major members, you're adopting the first language of a small member on the periphery (Ireland) that happens to be a second language of so many Europeans that no other European language comes close.
Still, English is probably an easier pill to swallow than the French having to speak German.
I think the political status of England should be decoupled from english, the language. The US have adopted it (while being on hostile grounds with the UK), so why can't we?
As long as the Irish stay, there's a solid case.
Even without the UK, English is probably the language most commonly spoken among EU member states.