Hacker News Reader

Are you running vision tasks? Works just fine in ollama as an LLM but the vision component is unimplemented.

I'm using gemma3:27b with the latest ollama (0.6.2) and vision is working.

Yes but we're talking about mistral 3.1 here, which doesn't have the vision component implemented, looks like vllm supports it though.

Mistral 3.1 vision works with MLX and mlx-vlm - https://github.com/Blaizzy/mlx-vlm/pull/256