Top New Best Ask Show Jobs

junrushao1994

336 karma · joined July 12, 2018

Junru Shao junrushao1994 at gmail.com Options are my own

submissions comments

Scaling LLama2-70B with Multiple Nvidia/AMD GPU

blog.mlc.ai·13 pts·junrushao1994·

MLC LLM: 70B Llama-2-4bit on MacBook at 50%-80% speed of A100

twitter.com·12 pts·junrushao1994·

Running RedPajama and other open LLMs on phones, browsers and AMD/NV/Intel GPUs

mlc.ai·11 pts·junrushao1994·

MLC: Bringing Hardware Accelerated Language Models to Consumer Devices

mlc.ai·8 pts·junrushao1994·

MLC-LLM: GPT/Llama on consumer-class GPUs and phones

github.com·303 pts·junrushao1994·