For instance, Twain spells "after" like "aafte", but in my accent I would probably spell it "afdr".
Twain has also run in to the problem that spoken English has far more vowels then written English does. He uses "ai" in both "minds"/"maindz" and "replace"/"riplais", but presumably they represent different sounds.
Presumably OP's system has the same problems with the dialects of Chinese, now that I think about it. Although I know very little about Chinese unfortunately (only what I know now from a few seconds of googling).