> It's not considered a "number" when society thinks of it in a higher conceptual abstraction than a number.

Which just shows that "number" itself is a conceptual abstraction, no higher or lower than the others.