I’d prefer it be an OS API.
You link your os to a local or cloud llm, and a local program asking the OS for a response and can’t even tell which one you’re using or whether it’s on the machine or not. It should all be abstracted away.
You link your os to a local or cloud llm, and a local program asking the OS for a response and can’t even tell which one you’re using or whether it’s on the machine or not. It should all be abstracted away.