>As far as I can tell, the only difference between those with and without an accent is conscious effort.

In my completely unscientific sampling, I'm going to agree with you. This holds true too for native speakers who make no effort to improve their grammar and vocabulary. If one wants to be a better speaker, writer, and communicator, they will be by effort.