What models or classes of models would I be able to run on that hardware?
I've asked myself that question while looking at some of the models on this: site https://laptopparts4less.frl/index.php?route=common/home
I've asked myself that question while looking at some of the models on this: site https://laptopparts4less.frl/index.php?route=common/home
This might not be enough to chew through a large code base but for smaller projects it can easily fit enough if not all of the code base to drive a good coding agent.
I don't recommend specific models or model providers due to how much hype and BS there is around benchmarks etc. Easiest is to check the latest generation of open models and look for a dense-type where a decent quant fits within the VRAM.
Some models run fast enough that some of the weights can spill over from VRAM to RAM while maintaining a usable prompt/token gen speed.