It *should* but I haven't tried it. I will try it. Updated in this issue:
We could also try raspberry pi + coral usb tpu (https://coral.ai/products/) - that might be a killer combo for super cheap home ai cluster.
We could also try raspberry pi + coral usb tpu (https://coral.ai/products/) - that might be a killer combo for super cheap home ai cluster.
I thought those were so memory limited that there was no useful way to run an LLM on them?