Hacker News Reader

So since a model is fine tuned via RLHF my point doesn't stand?

Genuine question; it would be interesting if some other mechanism was at play here.

For an answer I would expect it to get the same reward for both question orderings. So naively I would expect it to not be affected by the ordering.