If the restaurant is in a Historic District, and the board/commission/whatever in charge of that is generally opposed to pro-accessibility changes - who (other than the lawyers) benefits when the restaurant ends up as a de-facto abandoned building?
If my "handicap" is a severe peanut allergy, should I be able to demand that every restaurant have a separate, peanut-free kitchen - with only certified peanut-free ingredients, etc.? (One can repeat this argument for other allergies, people whose personal beliefs require kosher/halal/vegan/etc. food, and so on.)
If there are (say) 100 restaurants in a city, what is the marginal value for handicapped people of forcing a 101th restaurant to spend $$$$ to qualify as handicap-accessible?