With any luck projects like MLC will help close the gap

https://github.com/mlc-ai/mlc-llm