Hacker News Reader

Many AM4 boards that cost 70€ or so support 128GB RAM.

128GB = 4x 32GB DDR4 UDIMM costs less than 360€.

That's a lot less than the GPU.

iirc any CUDA requirement requires an Nvidia GPU

You can plug nVidia GPUs in AMD boards...

Yeah but that's out of the context of multiple am4 boards and their RAM caps being able to replace a GPU or being cheaper than a GPU.

Yeah they're technically cheaper than a GPU, but your costs are still gonna be up and they can't replace a GPU because regardless you'll need an nvidia card, unless there's a workaround for CUDA requirements.

I thought you need both a GPU and a lot of memory for the CPU.

tru

Computing neural nets isnt something a CPU is optimized for (matrix calculations), This tech is based on gpu optmized LSTM's, acka Transformers, they can run on cuda, reducing time. GPU's perform those calculations fast for huge matrixes. Doing it on a CPU (they're no good in fat matrix caclulations) it takes forever. And yes.. essentially those neural nets are extreme huge matrixes with some predictive math in between.

Reply on news.ycombinator.com