I encountered this a while ago, I've ended up bechmarking in relation to a past change and ensuring the percentage difference it's within a margin.

Not ideal but it's better than pure X vs Y.