The model is always wrong, since it predicts a propability distribution over all possible tokens, but the target has 100% possibility for one token and 0 for all others.

I mean this is implicit in back propagation, say, you need to store gradients anyway but if you get to a zero loss than you are just done.