When I compared llama2.c to llama.cpp it was way way slower.
All the mojo <insert number>x speed up claims I’m hearing about always use the baseline of some toy examples that nobody actually uses IRL.
Am I missing anything?
33 karma · joined July 4, 2019
When I compared llama2.c to llama.cpp it was way way slower.
All the mojo <insert number>x speed up claims I’m hearing about always use the baseline of some toy examples that nobody actually uses IRL.
Am I missing anything?
I'm using 2080ti for my "at home" projects and going above CUDA 11.0 is indeed breaks lots of things - good luck trying to make something like colab/kaggle docker image for DS where you have TF+torch+sklearn+more combo.
Would you mind sharing resources you used to assemble your software/driver stack for 3090x2 setup?
https://www.washingtonexaminer.com/news/san-francisco-school...
First time ever I'm genuinely frustrated with apple - macs are not those unicorn tools anymore that work reliable
Dystopian world ahead of us
Wut?! TIL where people got the belief that single communist party could rule democratically. We all know how about those experiments played out in history