It's really not just a problem with English. I'm learning Japanese currently and its absolutely filled with homophones that only change based on context.
For instance 子(child) 古(old) can both pronounced as "ko"
I only have a vocab of ~300 words but I can list at least a dozen or more off the top of my head. Far more than my experience with English.