Meh, each language has its quirks. I am a native Spanish speaker, and while English pronunciation is a clusterfuck, Spanish has its own share of issues for non-native speakers - like the need to memorise the useless the gender of words that refer to non-gendered things. Nobody cares that a table is female, but you won't sound native if you don't know it.
I'm told that some of the advanced forms of verbs (like the subjunctive) are real trouble for non native speakers, although at least learning that isn't a fruitless task.