I'm aware about the ability to overwrite error handler with a custom code, but Werkzeug's handler already supports pretty stack traces and much more, and I would rather not re-invent the wheel from scratch.

I was talking about using werkzeug's builtin exception handler but with custom headers - which doesn't appear to be supported.