Running the latest Llama 3.1 8B on Raspberry Pi [video]

youtube.com

26 pointsamrrs2 comments

This is great. It will be wonderful when the next gen of Raspberry Pi's include onboard NPU.

Please no! The damn things are already $60 a pop now. Let's keep such features as separate modules.