Generally the trick is regularise the inverse square law so that below a certain radius the force clips and stops things pinging off to infinity.