Some numbers represent real things. Like my little kid saw a pair of oven mitts and said 'two gloves'. Like, he was seeing a literal manifestation of two-ness in front of him - which is different than the logical idea of 1+1 or the symbol 2.
So you can physically see two of something. You can see ten of something. You can see a billion of something (sand on a beach). But at some point numbers get disconnected from concepts. We can easily say "ten to the power of million" as easily as "ten to the power of two" but the former is literally more than the number of particles in the universe. You can never encounter anything and say "oh, that's one with a million zeros of something."
Basically it seems like some numbers represent physical concepts (twoness, which can be manifested by a pair of mittens) and some numbers are purely theoretical.