"another group of researchers believe that we should not stop because we cannot be certain whether those who are trying to catch up with us will use the advancement of AI technology as a hidden weapon"
It's not just a potential weapon, but a potential source of untold riches and power.
That's going to be irresistible to anyone with an interest in either (ie. most politicians, governments, billionaires and corporations... and most ordinary people too, if they only had the means).