Yes this is how hyperagents work. They keep track of their different attempts to see which results in success. It does require tasks that can be measured.