Since they mentioned they’re working on Mistral-7B, I’d like to note that my GPU-only implementation of Mistral uses slightly over 5GB of VRAM: https://github.com/Const-me/Cgml

Runs pretty good on most consumer-grade GPUs, but so far it only supports Windows OS.