Why not normal RAM? Ryzen 5600 with 128GB DDR4 is perfectly fine to run mixtral 8bit, and costs less than $1000.
GPUs are only needed if you can not wait 5 minutes for an answer, or for training.
2 karma · joined January 27, 2024
GPUs are only needed if you can not wait 5 minutes for an answer, or for training.