People who are autistic are more likely to be turned down for jobs or relationships. They have poorer health outcomes. They don't get treated well by authorities such as police or the legal system. Autistic people are more likely to commit suicide than the general population. Education systems are designed for non autistic people. Even something as simple as going to the shops can be far more difficult if you are autistic.
Yes, it's incredibly offensive and people who are actually on the spectrum do suffer. But I think he might be right, that people claim to be autistic or have ADHD without formal diagnosis because it's trendy. It's the modern version of "omg I'm so ocd".
Are you knowledgeable enough in the area of neurodivergence to be relatively certain you are on the right side of the issue?