Here's what did the trick from me: learn how a plane works. In detail, every piece. What are flaps, what are ailerons, what is lift, etc. etc. Read all the Vanity Fair articles explaining famous crashes. When you understand it all, it demystifies flying, and it's a lot easier to feel comfortable in the air.
I've almost entirely lost my fear of flying since, even in turbulence. I take about 100 flights a year and 150k miles a year.