Running My Own LLM

I’ve been thinking of building a simple api middleman too. Something that can split it between local and openai depending on request and what’s online