I've gotten some useful stuff out of 7B param LLMs, and that should fit on a Pi quantized.