64 karma · joined November 14, 2016
What true though is that after taxes you might just receive 60% of your total salary once you deduct taxes and insurances.
From some announcements 2 years ago, it seems like they missed their initial schedule by a year, if that's indicative of anything.
For their hardware to make sense a couple of things would need to be true: 1. A model is good enough for a given usecase that there is no need to update/change it for 3-5 years. Note they need to redo their HW-Pipeline if even the weights change. 2. This application is also highly latency-sensitive and benefits from power efficiency. 3. That application is large enough in scale to warrant doing all this instead of running on last-gen hardware.
Maybe some edge-computing and non-civilian use-cases might fit that, but given the lifespan of models, I wonder if most companies wouldn't consider something like this too high-risk.
But maybe some non-text applications, like TTS, audio/video gen, might actually be a good fit.
AI might provide the most scalable way to give this level of access/quality to a much wider range of people. If we integrate it well and provide easy ways for doctors to interface with this type of systems, it should be much more scalable, as verification should be faster.
FAANG is not really a thing here and people are much more tech-luddite, privacy paranoid.
Just because a business might be unsound, doesn't necessarily mean it will imminently collapse.
There is a lot of money going around right now and at its core Cerebras is a hardware company and their core innovation is in hardware.
At its core Cerebras is a hardware company. If they would have been able to just sell hardware that would be great, but for now I think the available speedups are not really worth it to most people to reengineer their software to fit the computation model outside of a few niche problems and TCO is pretty high.
But given the amount of resources being poured into AI right now, a lot of these tradeoffs don't seem so far out anymore. The main open question I guess is whether their architecture will be a good fit for whatever requirements come in the future (think continuous training and RL stuff). Their architecture is sufficiently different, so there might be some valid reasoning to hedge your bets.
You can take almost any tech job, and there is a probably an argument to be made, that it is mostly reasonable given some other moral priors.
I think higher performance will be a key differentiator in AI tool quality from a user perspective, especially in use-cases where model quality is already sufficiently good for human-in-loop usage.
But once it's stable, it's outdated.