Tell HN: OpenAI Whisper Is Overfitted

I did notice this too. I tried to transcribe part of a movie and in the intro section in spitted out "The translations have been done by www.??.com". They clearly trained these on public SRTs

Does Whisper ever respond with "I don't understand" or does it always try to amble on and give an answer, no matter the confidence of the prediction?

Isn’t it one key feature of Whisper to transcribe in English?

Yes, but it did not hear German and transliterated it to English. It behaved as if it "heard" English translation.

I assume you set the language flag correctly?

It has a mode where it detects the language.