If these aren't enabled for containers / sandboxes yet, I bet they will be soon
810 karma · joined February 3, 2010
If these aren't enabled for containers / sandboxes yet, I bet they will be soon
With single instances topping out at 20+ TBs of RAM and hundreds of cores, I think this is likely very under-explored as an option
Even more if you combine this with cell-based architecture, splitting on users / tenants instead of splitting the service itself.
That's... largely what standards are?? And they are really beneficial??
That’s barely more than a raspberry pi? (4 vs 8 cores) Huge machines today have 20+ TBs of RAM and hundreds of cores. Even top-end consumer machines can have 512GB of RAM!
I do agree with the author that single machines can scale far beyond what most orgs / companies need, but I think they may be underestimating how far that goes by orders-of-magnitude
We can expect them to be better in 5 years, but your last assertion doesn't follow. We can't assert with any certainty that they will be able to specifically solve the problems laid out in the article. It might just not be a thing LLMs are good at, and we'll need new breakthroughs that may or may not appear.
That doesn't seem accurate for any of their computers? There is a pretty big leap from 32GB -> 64GB for the Desktop, but that is also a different processor.
> one from the clothes dryer (when I hold an incense stick up to it I can see it pulling in air even when it’s not running)
A normal vented clothes dryer can vent something like 8000 cu ft of air in a normal drying cycle (i.e. all of the air in their apartment). If that's running all the time somehow, that could definitely explain a lot. If that's the case they should fix it, and maybe explore ventless heatpump dryers.
Try using Spotify's mobile web app for an example. Works great.
“Here’s an error reported to the oncall. Give a try fixing it” (Could be useful even if it fails)
Refactor this small piece I noticed while doing something else. Small-scoped stuff that likely wouldn’t get done otherwise.
I wouldn’t ask LLMs for full-features in a real codebase but these examples seem within the scope of what they might be able to accomplish end-to-end
You likely need blunt feedback from someone you can trust in the industry
Using LLMs or other ML as components in systems themselves is a whole other thing, and I agree with you wholeheartedly.
But the same is true for code? You are held to the same standards as if you had written it yourself, whatever that may be. Frequently that is nothing.
What change do you want to see here?
I'm not in the business of prescribing philosophies on how others should live their lives?
I don't know why we're pretending that individuals have suddenly lost all agency and self-perception? It's pretty clear when you understand something or don't, and it's always been a choice of whether you dive deeper or copy some existing thing that you don't understand.
We know that if we cheat on our math homework, or copy from our friend, or copy something online, that's going to bite us. LLMs make getting an answer easier, but we've always had this option.
> Write a binary tree in C? Check. Implement radix sort in Python? check. An A* implementation? check.
You can look up any of these and find dozens of implementations to crib from if that's what you want.
Computers can now do more, but I'm not (yet) sure it's all that different.
You... might want to think about what implicit biases you might be bringing here