Hacker News Reader

Well, but those changes are triggered by something aren't they? So when you upgrade your font lib or pdf rendering library, you're warned that you're now generating different output and can update the golden set.

Your dependencies aren't changing without a cause are they?

View on HN

Yeah sure, it just starts to be a problem when you're having dozens of tests failing because of small rendering changes which can be ignored. Someone still has to look at all the test output, compare it to the old state and update the tests with the new state. In our case this happened quite a lot.

This is not an issue at first, but the more you use tests like this and the more people work with your code, false positives start to drag you down.

Reply on news.ycombinator.com