Checking for 500's seems like a pretty minimal test suite. There are plenty of other errors that could occur.
The options are either to spend a bunch of time trying to squash every potential bug, or know that some bugs will get through but at least users will benefit from having a bunch of new features to play with.