HNHacker News
TopNewBestAskShowJobs

MDK8888

42 karma · joined January 5, 2024

submissionscomments

A Minimal Implementation of Vllm

github.com·3 pts·MDK8888·
1

A Python Library to 6-7x the inference speed of your HF models

github.com·75 pts·MDK8888·
15

Show HN: SageMode - A Python library for deploying, scaling, and monitoring LLMs

github.com·3 pts·MDK8888·
1