Don't quote me on this, but I vaguely recall an explanation years ago, that the one-two punch of Norman French and the Great Vowel Shift arriving were enough for spelling and pronounciation to permanently decouple in English speakers' minds