As always, the immediate question: ChatGPT-3.5 (the free version) or ChatGPT-4 (the paid version)? Just saying “ChatGPT” doesn’t mean much.

It’s not very interesting at all to hear about ChatGPT-3.5 making mistakes, and an unlabeled reference to “ChatGPT” usually seems to mean ChatGPT-3.5. ChatGPT-4 is an entirely different level of product.

ChatGPT-4 can make mistakes too, and those cases are much more interesting since it is among the best LLMs on the market, so it is more representative of what current LLMs can (and can’t) do.

For reference, here is ChatGPT-4 discussing this: https://chat.openai.com/share/f67600f5-7d36-49b7-b136-f77dcb...

I don’t know that language, so I can’t say how accurate it is. For the languages that are represented well in its training data, ChatGPT-4 seems capable of really good translations.