The underlying problem is that infinity doesn't exist. It's a convenient illusion to make special cases go away. It's possible to have entirely constructive mathematics. In a true constructive model, everything can be constructed in a finite number of steps. There are only integers, no reals.