This assumes that each bounce takes the same time to complete instead of also tending to zero.
If you expect that each bounce also takes a smaller amount of time to complete, a series of infinite bounces takes a finite amount of time and therefore a finite distance.
At the point in time and distance where the bouncing ends, the forward motion of the ball (unimpeded by friction) continues in a slide along the ground.