Okay if anyone wants to try Llama 3.1 inference on CPU, try this: https://github.com/trholding/llama2.c (L2E)

It's a bit buggy but it is fun.

Disclaimer: I am the author of L2E