HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by nshotton | Hacker News Reader
Parent
Full thread
nshotton
·
sweet, is there any plans to implement VLLM in the future?
View on HN
segmenta
·
vLLM works today - it exposes an OpenAI-compatible endpoint, and you can point Rowboat at a custom base URL in model settings.
Reply on news.ycombinator.com