Hacker News Reader

are there plans to release an official GGUF version to use with llama.ccp?

It is already part of the release on Huggingface: https://huggingface.co/google/gemma-7b/blob/main/gemma-7b.gg...

It is a pretty clean release! I had some 500 issues with Kaggle validating my license approval, so you might too, but after a few attempts I could access the model.

I didn't see this when searching thanks

Reply on news.ycombinator.com