To be fair, they did stop to think if they should. The decided that they shouldn't and went ahead and did it anyways.
If we're in a simulation, maybe it's a simulation about the dangers of AI.
If we're in a simulation, we are AI. But someone could be studying what happens when AI makes its own AI.
They will 'soon' (few 1000 years max) shut us down probably.
This one of the places to manufacture the consent for that to take place, because we are commenting within an organization that has given the money to ensure it that what could be is done. Most people clapped and made money, who cares what happens next, making money is the only good that matters.