Especially for driving, I think most people are above average. This is because the distribution of driving ability is negatively skewed, meaning the tail on the left is longer than the tail on the right.
If you were to put a number on driving ability, most people would get something like a seven (out of a maximum of 10).
In my opinion, there would be a very small amount of two's and fives. There would also be a small percentage that would get a one out of a maximum of a ten. (The drivers that don't follow the speed limit, make dangerous overtaking maneuvers, and are agressive towards other drivers).
I think those drivers make most people claim they have an "above average" driving ability.