Hacker News Reader

That's a good point. Are you referring to the out of date cuda libraries?

I don't remember exactly (either cuda directly or the cudnn version used by the flashattention)... Anyway, /r/localLlama has few instances of such builds. Might be really worthwhile looking that up before buying

Reply on news.ycombinator.com