Also, if something goes wrong in production, it's easier to find the cause. Just look at the most recently deployed code change.
In your situation, I would look for ways to detect the issues earlier. Ideally, you know about it before the user does (which is easier said than done, I know). Added benefit of this: quicker feedback will help you pinpoint the problematic release ;-)