> Iteration itself isn’t inherently bad. It’s just that the objective
> function usually isn’t what we want from a scientific perspective.
I think this is exactly right and touches on a key difference between science and engineering.Science: Is treatment A better than treatment B?
Engineering: I would like to make a better treatment B.
Iteration is harmful for the first goal yet essential for the second. I work in an applied science/engineering field where both perspectives exist. (and are necessary!) Which specific path is taken for any given experiment or analysis will depends on which goal one is trying to achieve. Conflict will sometimes arise when it's not clear which of these two objectives is the important one.