I speak a second language fluently, and after spending several weeks immersed in that second language I'll sometimes notice that my internal speech switches to it as well, especially when I'm thinking about concepts that I've verbalized/discussed in that language.