That, right there, is one of the least helpful things that can ever be said in these kinds of circumstances. It's understandable, and it's common, so this doesn't lay blame on you, but on the underlying cultural assumption.
"Aren't we all?"
Those who have truly neuro-atypical behaviours, to where it can be assessed as placing them somewhere else on the spectrum, will receive less helpful responses when people think along those lines. Their concerns are more easily pushed aside, and the things that can help bridge the gap are less easily implemented.
It may sound accepting, but it's a trivialising statement. It makes things harder, for everyone.