This is a great idea- I hope that you are wildly successful.
I’m an AI skeptic mostly because I see people rushing to connect unreasoning LLMs to real things and as a result cause lots of problems for humans.
I love the idea of human-in-the-loop-as-a-service because at least it provides some sort of safety net for many cases.
Good luck!