5900x, 3090 24gb (slightly undervolted), 128gb ddr4, running via Ollama.
I am benchmarking it now locally, will put the results and speed/tps on aibenchy.com
I am benchmarking it now locally, will put the results and speed/tps on aibenchy.com
There's some YouTube guides for it.
I also undervolted my new 5070ti, same tdp, around 260w instead of 300w and like 8% better performance.