That's pretty much the point I was making. The whole community has to buy into the value of education. If you are getting harassed by your peers because you are reading a book for enjoyment, you are likely going to stop.
My intention was to point out that “you just need the desire to pursue it” is often not just a “you” problem, unfortunately, since people are heavily influenced by their environment.