Hacker News Reader

`ollama run mistral` <-- literally thats it

For anyone wondering - no need to download anything from Mistral website. Download ollama and use this command.

Heads up that this app is extremely obnoxious and upon launch installs itself in to your startup items for zero fucking good reason.

Quite true. I actually submitted a pull request [1] over a month ago to make it clear to potential users what will happen when Ollama is launched for the first time, but based on the complete lack of response from Ollama developers, I get the distinct impression that they are reluctant to draw attention to these important details. Unfortunate.

[1]: https://github.com/jmorganca/ollama/pull/395

How come one blog post with the torrent magnet of mistral says I need 24g vram but ollama says I only need 8g regular ram minimum?

If I wanted to experiment with working with models and finetuning offline should I just save for a 32g vram+ video card?