It just felt wrong, thanks for letting me know. Seems weird to run an orchestration system in another one. Fly wasn't meant to be a VPS / server host and using it as one seems odd to me.
edit: And here they say they're replacing nomad with their own thing: https://fly.io/jobs/platform-engineering/