Things such as AirLLM, or good old llama.cpp.