The problem is that just about everything breaks the API. I have had situations where obscure bug fixes break my app because I was depending on the behaviour of that bug.
The answer IMO is to just do a full test of your stuff after doing updates. I update many packages at once to make the most of my time.