If people spend a great deal of resources on something that's obviously stupid, you probably don't understand their reward function as well as you think you do.