I think that fact doesn't sit well with some people and that's worth exploring. Perhaps wanting bucket people to be "neurotypical" or "neurodivergent" (rather than on a normal distribution) may reflect an underlying desire to have an ingroup or outgrop, for example.
Interestingly Simon Baron-Cohen (Yes, Borat's Brother!) proposed the theory that a ton of intelligent people in professional fields and/or academia called "systemizers" carry a slight predisposition toward autism and mate with each other [1]. I haven't followed up how well his theories have held up in the last 5 years.