336 karma · joined January 11, 2021
P.S. The printer gag was cruel, just saying.
Framework 13 Pro: £2064 (Ultra X7 358H, 16GB, 1TB, default ports, no adapter)
Framework 13 Pro: £2264 (Ultra X7 358H, 32GB, 1TB, default ports, no adapter)
MacBook Pro 14: £1699 (M5, 16GB, 1TB, no adapter)
MacBook Pro 14: £2099 (M5, 32GB, 1TB, no adapter)
MacBook Pro 14: £2199 (M5 Pro, 24GB, 1TB, no adapter) - added as I think it’s an even better deal
[0] https://www.reddit.com/r/GoogleGeminiAI/comments/1jrynhk/war...
* LLaMA 3 8B: baseline 72.26, 4-bit 71.31, 3-bit 62.79
* LLaMA 3 70B: baseline 79.51, 4-bit 78.06, 3-bit 74.68
These results seem comparable to modern quantization methods—for example, the ~4-bit results for smaller LLaMA models listed here: https://ai.meta.com/blog/meta-llama-quantized-lightweight-mo...
[1] https://www.tomshardware.com/pc-components/cpus/amds-beastly...