Here’s an m1 guide I found. https://simonwillison.net/2023/Aug/1/llama-2-mac/

Start with a 7B model then go from there. I used kobold ai but that didn’t seem too well recommended for macOS.

Raspberry pi 4B can do 3B models or 7B at one question per hour or so for now. Can quantize them for faster but then the answers are worse.