I would frame it as inverse. Rather than aiming at reducing the risk of harm, our Ami should be matching the incentive to get personally rich with a corresponding risk of personal bankruptcy or criminal liability. That wouldn’t just incentivize safety, it would incentivize abstaining from activities with insufficient confidence of avoiding even long tail risk.
More importantly it would incentivize the entire industry at the same time by injecting caution into the yolo speed run we have now. No frontier lab or single user hobbyist would take imprudent risk in the hope that they get rich if they also risk the full weight of consequences.