>basically a GPT-4 level model
Can you share more insights on this? Going by @simonw's testing, the quantized model doesn't seem close to GPT-4 level.
Can you share more insights on this? Going by @simonw's testing, the quantized model doesn't seem close to GPT-4 level.