I'm not sure what's involved with serving these llms or if the infra could be completely seperate or not for an internal one.