Actually, I often find that I can fluently exchange with someone speaking English (which is not my native language), but if a third person ask me to translate, it's really a higher level of complexity to find the relevant expressions.
I understand that at the start, one feel more at ease to use its know point of reference in languages already known, but at some point this scaffold is only an additional layer that slows down your expression flow, isn't it?