By the same token, you shouldn't think of a real "number" as a number, but as an infinite sequence of rational numbers. Yes, all of the reals are infinite sequences of rationals.
Also, a rational isn't a number but an ordered pair of integers. (Technically, the set of the rationals is the set of all ordered pairs of integers (excluding the ones with zero in the second position) with an equivalence class defined on them.)
The integers are also not numbers, but the naturals with a sign adjoined to them.
Finally, the naturals aren't numbers but sets of sets, with zero the empty set and all further integers built inductively from that.
So... what does it really gain you to look 'inside' the numbers you use?