eadwu

For this form factor it will be likely ~2 years for the next one based on Vera CPU and whatever GPU. The 50W CPU will probably improve power efficiency.

If SOCAMM2 is used it will still probably be at most near the range of 512/768 GB/s bandwidth, unless LPDDR6X / LPDDR7X or SOCAMM2 is that much better, SOCAMM on the DGX Station is just 384 GB/s w/ LPDDR5X.

Form factor will be neutered for the near future, but will probably retain the highest compute for the form factor.

The only way there will be a difference is if Intel or AMD pump their foot on the gas, which this makes maybe 2/3 years of it, with another 2 years unless they have something cooking it isn't going to happen.

996 are existed for a long long time. Heck I've done 12 12 7 during my teen years in summer vacation.

It's not a big deal. It's just startups doing their thing and the press capitalizing on views with headlines.

People have done more with less for a long time (basically with the Jetson counterparts).

The only likely difference with DGX Spark is that it'll be a more desktop-centered platform, what people can do with it, not sure, but say for VR, the DGX Spark is basically the best compute puck for one right now.

Most people are missing the point. LLMs are not the be all end all of AI.

Even if you were to say memory bandwidth was the problem, there is no consumer grade GPU that can run any SoTA LLM, no matter what you'd have to settle for a more mediocre model.

Outside of LLMs, 256 GB/s is not as much of an issue and many people have dealt with less bandwidth for real world use cases.

The biggest change is having money.

People generally envision something that is more akin to a product than a prototype, and one thing money is good at is that if you have enough, you can get far closer to that vision faster by dumping it.

I don't use any AI code editor. Not because it isn't useful, but the user experience of using it is so bad. I typically already have the solution at hand - I don't need an AI to give me an answer, I need it to implement the solution I have.

But not using AI is also idiotic right now, at the very least you should be using it for autocomplete, in the _vast_ majority of cases any current leading LLM will return _far more_ than not using it (in the scope of autocomplete).

If only they kept their "Debian Free Software" name instead of hijacking another word ...

If you are the type of person who writes a big brain log(n) solution instead of n solution when there is no real reason (compute wise) and the log(n) is a pain in the ass to maintain.

I hope I never see you in my team.