I thought the whole point of the idea of "the autistic spectrum" was that everyone was on it to some degree?

no. there are gradients of autism. https://link.springer.com/article/10.1007/s10803-016-2760-2