I will seriously consider adopting it as long as it supports streaming matches (it seems like it does).
2,184 karma · joined March 19, 2015
(feel free to email me at my full name [at] outlook.com).
I will seriously consider adopting it as long as it supports streaming matches (it seems like it does).
In a lot of ways it’s like investigations into airplane crashes.
My mom had no trouble adjusting to it. It was all just computer to her in some ways.
I think your argument is still true overall, though, since there are a lot of "gpu poors" (i.e. grad students) who write/invent in the CUDA ecosystem, and they often work in single card settings.
Fwiw Intel did try this with Arctic Sound / Ponte Vecchio, but it was late out the door and did not really perform (see https://chipsandcheese.com/p/intels-ponte-vecchio-chiplets-g...). It seems like they took on a lot of technical risk; hopefully some of that transfers over to a future project though Falcon Shores was cancelled. They really should should have released some of those chips even at a loss, but I don't know the cost of a tape out.
A few projects just in ML: DeepMind has plenty enough for Google alone but Jax and the TPU project are technically ambitious and very strategically important for Google; they hired Adam Paszke away from Meta. Besides Gemini they have Gemma and Veo and they have a reputation in the industry of having extremely high MFU averages. From Facebook there's PyTorch but that's a whole cluster of projects (compiler, abstractions for many accelerators, torchao, torchtitan). They're also famous for DINO and SAM models, as well as many others by FAIR (e.g. Mask R-CNN).
I use a lot of nonstandard software (not just a browser), not a single piece needed Rosetta.
I agree recent AMD chips are power efficient like the M series (though I don’t have one to compare with) but I thought everyone agreed the comparable chips in 2020 weren’t?
Smart context / big context is a really interesting question, I’m kind of surprised Google isn’t building here given how much effort they’ve put into big context (they have Jules and Gemini CLI but no tab completion UX).
On further thought I think one of the big 3 (OpenAI, Google, Anthropic) should partner (ideally not buy) with Zed to get a foothold.