care to elaborate? i have rtx 4070 12gb vram + 64gb ram, i wonder what models I can run with it. Anything useful?
So if you go to this[0] random model, on the right there is a list of quantifications based on bits, and those you can run will be shown in green.
[0] https://huggingface.co/unsloth/Mistral-Small-3.1-24B-Instruc...
For my 16gb of VRAM, those models do not include anything that's good at coding, even when I provide the API documents via PDF upload (another thing that LM Studio makes easy).
So, not really, but LM Studio at least makes it easier to find that out.