Hacker News Reader

Yeah but that's out of the context of multiple am4 boards and their RAM caps being able to replace a GPU or being cheaper than a GPU.

Yeah they're technically cheaper than a GPU, but your costs are still gonna be up and they can't replace a GPU because regardless you'll need an nvidia card, unless there's a workaround for CUDA requirements.

View on HN

I thought you need both a GPU and a lot of memory for the CPU.

tru

Computing neural nets isnt something a CPU is optimized for (matrix calculations), This tech is based on gpu optmized LSTM's, acka Transformers, they can run on cuda, reducing time. GPU's perform those calculations fast for huge matrixes. Doing it on a CPU (they're no good in fat matrix caclulations) it takes forever. And yes.. essentially those neural nets are extreme huge matrixes with some predictive math in between.

Reply on news.ycombinator.com