I take your point, though I'm not sure taxes are the answer. Very rarely is air travel even close to the cheapest option (in the US here, Europe has low cost airlines that may shift the math). Although I'm pretty well off as compared to the average person, I don't know anyone personally who takes the plane purely on a whim, and I know nobody who prefers to fly when another comparable time option is available. If you were to tax air travel at say 10%, that would likely not change my travel, just make it more expensive. A $200 ticket now costing $220 isn't going to make me not take the flight. If you tax it more, sure I won't take the flight, but then you reduce quality of life given that in many places the alternatives don't exist.
In Europe I usually take the train places. If it's 2-3h away by train it's usually faster to take the train, and it's often (though not always) comparable or cheaper on price. In the US, I virtually never take the train, there simply aren't adequate options. The distances tend to be much larger, and we simply haven't built the infrastructure. We could build it, but that's proven quite hard (see CA high speed rail and efforts to modernize northeast corridor) for both political and practical reasons. NY<->DC I often take the bus, it's cheaper and only a slight time penalty vs. the train.
4/5 people sounds like a big number but those people are much more likely to start eating meat or buy a car at first than to fly. That's a way bigger problem environmentally.