Yeah, exactly. You would define a HitL server and the actions it implements would be API calls to your system.
i do think that AI-calling-tools is insufficient to provide bidirectional communication rails for user input/review though...not disagreeing just maybe thinking out loud a little here