Fair point. I’ll repost as a regular submission instead of Show HN. The goal was to demonstrate the runtime behavior behind multi-model serving rather than a polished end-user app. Appreciate the clarification.
Happy to engage with you if Hulu have any additional questions. Thanks for all the feedback.that was helpful