I found myself irrationally enraged and had to walk away from the conversation. I thought about it when I calmed down and I realized I was feeling, "Who the fuck are you to tell me how I can live in the world?"
Dissecting these thoughts further led me to the understanding that, without accessibility, you are telling a class of people that they don't deserve access to education, government services, or commercial products.
Telling disabled people that they don't deserve access to any benefits of a civilized society is a long-standing and persistent attitude. It's roughly analogous to denying poor people health care, food, and basic shelter because all they deserve is what scraps we are willing to bestow on them.