Web LLM looks promising: https://webllm.mlc.ai/ And I hope we can offer this as an option with Mistral in the coming months.