> Yes, you can run this model! Your system has sufficient resources (16GB RAM, 12GB VRAM) to run the smaller distilled version (likely 7B parameters or less) of this model.
Last I checked DeepSeek R1 was a 671B model, not a 7B model. Was this site made with AI?
OP said they "vibe coded" it, so yes.
Here[0] are some 1.5B and 8B distilled+quantized derivatives of DeepSeek. However, I don’t find a 7B model, that seems totally made-up from whole cloth. Also, I personally wouldn’t call this 8B model “DeepSeek”.
0: https://www.reddit.com/r/LocalLLaMA/comments/1iskrsp/quantiz...
Not technically the full R1 model, it’s talking about the distillations where Deepseek trained Qwen and Llama models based on R1 output
> Yes, you can run this model! Your system has sufficient resources (16GB RAM, 12GB VRAM) to run this model.
No mention of distillations. This was definitely either made by AI, or someone picking numbers for the models totally at random.
That's not ideal from a token throughput perspective, but I can see min working set of weight memory gains if you can load pieces into vram for each token.