It's a simple way of running something quickly and without touching the rest of your system (if you already have Docker installed)
Anyway, the proxy is just an nginx with a custom config file. You can check that file and just add it yourself to an nginx you manage, probably with little changes.
https://github.com/signalapp/Signal-TLS-Proxy/blob/main/data...