It's more than that.
I have an amazing chocolate cake recipe--I'm SURE it's cribbed from some magazine, chocolate container, or something. I have stopped giving it out as people simply can't get it right.
There are three classes of failure:
The first class of failure is in not following directions. When it says "1/2 teaspoon", they mean it. Baking is like lab--small things often make big differences. "Helping" one of these people is frustrating--"Um, try actually following the recipe."
The second class of failure is that a lot of people don't have basic cooking skills. "My chocolate is weird"--yeah, water does that to melted chocolate. "I can't whip this meringue"--yeah, you can't get even a trace of yolk in that or it's not going to work.
The third class of failure is that people don't seem to pay attention and learn. Hmmm, that cake recipe doesn't seem to like humid days. Uh, oh, there aren't any bubbles in my batter--my baking soda/baking powder are probably bad. Sniff, sniff--that doesn't smell right--did you use margarine or butter to prepare that pan?
One of my favorite for this was reconstructing my grandmothers kalach recipe. It just never smelled right. Until I remembered that she used to have a container underneath the cabinet that she used for the recipe--as a kid that never meant anything. As an adult, I was like "Hmmmmm, I bet that was lard." Sure enough, that made it smell right.
Cooking requires paying attention, but baking, especially, is in the details.