I bet you have ugly flaws in your spoken English, although I also bet that your written English is better than many brought up speaking English.
I often deal with tourists, and I detect serious flaws in their speaking as a result of their learning to read and write first (transliteration is a problem too). Common ways of teaching English in schools are deeply flawed IMHO.
Babies and children learn by listening, talking, mimicking, and some correction.
The best late learners of speaking English that I have met, have been those that interact by talking and mimicking, with very little (if any) reading/writing. My favourite was a young Japanese guy that had worked in East London and Australia, and his accent would switch between perfect Cockney and perfect Ocker depending upon where he had learnt a phrase!
Personally, my Spanish only really improved when I had a Spanish speaking girlfriend that didn't want to speak English with me.
Obviously if you mostly interact in English by writing, it doesn't matter.
But if you want to work in a country, you will usually be judged quite negatively if you have a strong accent.
Also clearly not everyone can find a way to talk with native speakers.
Learning by listening to movies and mimicking songs including accent of the singer helps a lot and is fun. (e.g. in my experience Spaniards typically have horrific English due to dubbing films into Spanish, while Portuguese often are way better at English).
Ideally limit reading and limit learning grammar/spelling until after you have a good grasp of the language. That's how all native speakers have done it.