Hacker News Reader

Alpaca already works in just 4GB of RAM. This stuff is moving incredibly fast.

It doesn't work well at all. (Also alpaca.cpp uses 8GB of RAM for a 4GB model, possibly because they don't know how mmap works.)

alpaca lora is quite capable actually and is suddenly gaining a hell of a lot of traction in the corporate world