There is a big difference between infinite and very high gravity. Neutron stars have only about 50% time dilation on the surface, as the surface is at about 50% their Schwarzschild radius.