Any organization that wants to accomplish something must be ableist in some way. Universities are for people who are above average in intelligence, which immediately excludes more than half the population.
No, the real issue with "ableism" is the scarcity of resources or efficiency. Some people are just more efficient or capable at achieving particular tasks or goals. An attack against ableism is an attack against capitalism and efficient allocation of resources.