I couldn't find any gguf files yet. Looking forward to trying it out when they're available.
Feature Request: Support Zyphra/Zamba2-2.7B #8795
Open tomasmcm opened this issue on Jul 31 · 1 comment
The model card states that you have to use their fork of transformers.[2]
1. https://huggingface.co/Zyphra/Zamba2-7B-Instruct/blob/main/c...
2. https://huggingface.co/Zyphra/Zamba2-7B-Instruct#prerequisit...