Well, agents are intentionally trained with RLHF to solve captchas that say “prove you’re human”.