No, that logic makes perfect sense. Firms can charge whatever they want. If you cost more to fly, then firms can charge you for that.
The ADA is generally regarded as a generally good thing, especially insofar as it influences the design of new construction to be more accessible to begin with, but it's not without flaws (e.g. turning disabled persons into liability factories - http://www.mercurynews.com/2016/04/10/serial-ada-lawsuit-fil... ).
It's far less clear that we should levy a similar mandate on every business ever in order to mitigate every single difference in life circumstances. In the case here, it should be quite reasonable for airlines to charge people for a portion of their carriage by the kilogram, like they already charge people for extra leg room - it'd make tons of sense, and the only reason that they don't do it everywhere already is because a standardized price makes the transaction easier to accomplish.
Let me quibble with that slightly as it is a pet peeve of mine: we are all going to get old. Facilities for "the disabled" benefit EVERYONE eventually.
Weight X Distance X rate
Treat humans like Packages, I am sure that will go over well