Trying VLLM Ideas on Apple Silicon with MLX (WIP)

Hey HN!

I’ve been experimenting with MLX (and mlx-lm / mlx-vlm — great work by others) and started a small WIP project to see how vLLM-style ideas could work on Apple Silicon.

It’s super early, just me tweaking things and learning, but if you’re into MLX or running LLMs/VLMs on a Mac, I’d love feedback or contributors.

Repo: https://github.com/waybarrios/vllm-mlx