Hacker News Reader

Comment by spindump8930 | Hacker News Reader

Care to comment on this model from a quite serious company being labeled as derived from GLM?

Also, do you have a source for: "99% certainly european chips, almost certainly EIC-funded. (Eg. Hailo, Axelera, ..)"

For Hailo, the best I can find is https://hailo.ai/products/ai-accelerators/hailo-10h-m-2-ai-a...

Which states that this is a 40 TOPS int4 PCIe device, not what you'd put in a datacenter and certainly not what can run a frontier class model (or the model above). Embedded devices for inference are really cool! But that's the opposite end of scale for what goes into a data center.

View on HN

I was sharing the EIC backed ones, but it's fair that in a datacenter it's more likely to be Axelera (or vsora/semidynamics if you start digging into earlier-stage competitors). Nvidia is the only American company selling AI chips to datacenters at scale but they're a huge supply chain risk so it's most DCs don't do single-supplier either way.

You'd need to compare by volume. And when you do that - unfortunately - NV is by far the largest supplier. 'Most DCs' are effectively single-supplier. And I wish it weren't so. This is the hard one to crack, NV needs credible competition. AMD and Intel are the only two majors that potentially could do this but they're both way behind where they should have been today.

I remember doing my first bit of 'shader repurposing' a long time ago thinking 'wow, I wonder whether Intel realizes this graphics card is the more powerful processor in my computer'. Back then (in the pre-CUDA) days you had to contort yourself in the worst possible ways to get any kind of unintended computation done but when it worked it was amazing. Since those days NV has been pumping enormous effort into building out that miniscule head start that they had in the days of 'Brook' and the subsequent release of CUDA. It is going to cost a lot of money to duplicate that, and even more to compete with NV on what is now their home turf. But I really wished someone with very deep pockets would do just that.

Reply on news.ycombinator.com