Hacker News Reader

I wonder how this would stack up against 4x RTX 3060, assuming you have the physical room for them.

Since the 3060s would have to communicate constantly using pcie, I think I'd go with intel

Currently software is king when it comes to inference performance though.

Having the entire model in the vram without having to transfer anything is even more king, though