There is a big difference between infinite and very high gravity. Neutron stars have only about 50% time dilation on the surface, as the surface is at about 50% their Schwarzschild radius.
Don’t you mean 100%? From what I can tell, the radius of a neutron star is about twice its Schwarzschild radius.