That is, hearing,"You're so smart," so many times, from teachers, other students, coworkers, bosses, etc., cultivates a sense of elitism and a shock when something is actually difficult.
You're also bound by the same emotions as most other people. If you're a particularly aggressive or irritable person, imagine being surrounded by people who keep making mistakes because they're stupid. If you turn it outward, you're impatient at best and a bully at worst. If you turn it inward, you're stressed out, anxious, and depressed.
All of that said, being a professional programmer was the most satisfying thing I've done. Unfortunately, I moved on precisely because of the above paragraph -- I had managers I felt were particularly dim.