Hacker News Reader

What does it take to go from here to a model on a pcie card or an m.2 card, so I can plug one into my workstation / laptop? Will 'intelligence' become much like a gpu, where most people just live with the performance of whatever they have installed, outside large companies that must have cutting edge, or prosumers that have a incrementally better version than the masses?

Are we a couple years away, a decade away, or something else?

View on HN

> What does it take to go from here to a model on a pcie card or an m.2 card

It is already that.

> Will "intelligence" become much like a gpu

As an option among the implementations.

> Are we a couple years away

They could mass produce now, but it makes no sense at this rate of improvements in the models.

Thanks for answering. This is an 8b model, which are mainly curiosities outside niche tasks. I guess I am asking how far we are away from having today's more generally useful frontier model equivalents widely available for everyday users in their personal pcs/laptops via a single pcie or m.2 drop in.

> how far we are away from having

It depends on AMD now. What was planned after the 8b was a ~30b, which is already sufficient (or more, when running at ultra-high speed).

Reply on news.ycombinator.com