It's possible, yeah. The system is general enough that it would work.
I'm considering exposing an API version. You set up a shared memory, then you hit the API as if it were an LLM. The underlying model could be configurable, the shared memory would be handled opaquely.