Interesting. I definitely noticed the same issue with my English.
My mother tongue Croatian had a reconstruction of the alphabet in the 19th century and these kinds of issues never appear. The orthography is phonemic almost. So the word you think matches to each tap when thinking of how it sounds.