Mathematics is just an exercise in symbol manipulation according to a particular rule set. Mathematics is a _game_. Park Place exists in the context of a game of Monopoly and also exists in Atlantic City. The tokens in a game of Reversi don't correspond to anything in the real world. You might be playing it on a physical board of a particular size, but you could just as easily play it on an imaginary board, or on a piece of paper, or a computer, or in some imaginary board of infinite size. Whether or not either exists in "reality" doesn't matter in the context of the game, though.
If the rules of mathematics allow for infinities, then they exist in the context of mathematics. Whether they exist in reality doesn't matter. You can still say things that are true about these imaginary objects in the context of the game that everyone is playing with these symbols, just like you can say things that are true about the game of Reversi, even one played entirely in the minds of two players on an imaginary, infinite board.