I think the point of the parent comment is that, although English is full of borrowed words and phrases, you're not switching to speaking French/German/Latin while saying them. You're still speaking English, it's just a subset of English which was borrowed from somewhere.