5,907 karma · joined June 19, 2019
Don't get me wrong, AI is at least as game-changing for programming as StackOverflow and Google were back in the day. Being able to not only look up but automatically integrate things into your codebase that already exist in some form in the training data is incredibly useful. I use it every day, and it's saved me hours of work for certain specific tasks [0]. For tasks like that, it is indeed a 10x productivity multiplier. But since these tasks only comprise a small fraction of the full software development process, the rest of which cannot be so easily automated, AI is not the overall 10x force multiplier that some claim.
[0] https://en.wikipedia.org/wiki/Dune_(franchise)#Butlerian_Jih...
What is the advantage of this? Unless you need something exotic like different kernel configurations per instance, what's the problem with using containers on the same instance?
BTW, a Hetzner dedicated server with 2 CPUs/8GB RAM that would let me run my own hypervisor is about $14 USD/month. For anyone who's a big enough power user to care about the distinction of running distributed workflows on VMs versus containers, I'm not sure that an extra $5/month is worth your "hypervisor as a service." But then again, HN commenters infamously poopooed Dropbox [0], so what do I know? :-)
— $20/month
— 25 VMs
— 2 CPUs
— 8GB RAM
— 25GB disk
— 100GB bandwidth
Is this 2 CPUs/8GB RAM per VM (in other words, 50 CPUs/200GB RAM)? If so, this is an unbelievable bargain (too good to be true?); other cloud providers charge hundreds of dollars per month for an equivalent VM.
If, OTOH, it's 2 CPUs/8GB total, Hetzner offers an equivalent VM for about $5/month (with much more disk and bandwidth), and I'm not sure what the exe.dev value proposition is. (I'm also not sure why one would want to split 25 VMs across so few shared CPUs/such little memory.)
My brother's electrical company needed hundreds of Schaltpläne (circuit diagrams).
Drawing each by hand = 5 hours per plan
100 drawings = 500 hours = 12 weeks
Professional CAD work? Unbezahlbar (unaffordable).
The secret weapon: AutoLISP
A programming language built into AutoCAD
The Result: 99.5% time saved
100 drawings: 12 weeks → <1 hour
This is a general pattern of how automation (including the recent wave of gen-AI) reshapes the labor landscape. Automation rarely replaces jobs wholesale (i.e. very few people get fired because their position was "outsourced" to automation). Rather, automation lets people who are proficient in Domain A who need some work done in Domain B become proficient enough in Domain B with sufficient ease that it's cheaper for them to pick up the requisite Domain B skills themselves versus hiring a Domain B specialist.That privilege may well be a necessary condition towards being able to publish a paper that shows extreme computational sophistication for a high schooler (and indeed, IMO would be a middle-of-the-road graduate-level paper). But it's certainly not a sufficient condition, as you seem to be implying when you say that blindly giving a kid $10-$20k is "effectively the same" as having Matteo's background. If you just handed $20k worth of GPUs to a rich dilettante child, they would not be able to achieve anything close to what Matteo accomplished.
[0] https://www.justinmath.com/math-academys-eurisko-sequence-5-...
That GPU was first released in 2018, and can be had for ~$1500 today. The computer as a whole sounds exactly in-line with what a lab would have as an old spare machine. The student is lucky for sure to have access to such an institution, but it's not like he had rich parents who casually handed him $10-$20k. Much more likely he got access to Caltech resources because his exceptional talent caused a professor to take interest in him:
"I would like to acknowledge and thank deeply my mentor Davy (Dr. J. Davy Kirkpatrick) for introducing me to astronomy at IPAC and providing guidance throughout this project, aiding in data analysis and the collection of known objects for the test set."
[0] https://iopscience.iop.org/article/10.3847/1538-3881/ad7fe6
Don't get me wrong, AI is at least as game-changing for programming as StackOverflow and Google were back in the day. I use it every day, and it's saved me hours of work for certain specific tasks [2]. But it's simply not a massive 10x force multiplier that some might lead you to believe.
I'll start believing when maintainers of complex, actively developed, and widely used open-source projects (e.g. ffmpeg, curl, openssh, sqlite) start raving about a massive uptick in positive contributions, pointing to a concrete influx of high-quality AI-assisted commits.
[0] https://mikelovesrobots.substack.com/p/wheres-the-shovelware...
[0] https://community.spotify.com/t5/Community-Blog/Introducing-...
[0] https://retro.swarm.cz/20170331/windows-31-running-on-ibm-ps...
>I do thoroughly audit all the code that AI writes, and often go through multiple iterations
Does this actually save you time versus writing most of the code yourself? In general, it's a lot harder to read and grok code than to write it [0, 1, 2, 3]. For me, one of the biggest skills for using AI to efficiently write code is a) chunking the task into increments that are both small enough for me to easily grok the AI-generated code and also aligned enough to the AI's training data for its output to be ~100% correct, b) correctly predicting ahead of time whether reviewing/correcting the output for each increment will take longer than just doing it myself, and c) ensuring that the overhead of a) and b) doesn't exceed just doing it myself.
[0] https://mattrickard.com/its-hard-to-read-code-than-write-it
[1] https://www.joelonsoftware.com/2000/04/06/things-you-should-...
[2] https://trishagee.com/presentations/reading_code/
[3] https://idiallo.com/blog/writing-code-is-easy-reading-is-har...
I wonder if an approach like KKeyboard with larger but statically combined keys leads to faster typing than the current approach with smaller but dynamically "combined" keys.
[*] In reality, the context is modeled using a simple Hidden Markov Model with a much smaller effective context window that could not associate "Paris" and "France." But you get the idea.
[0] https://forums.macrumors.com/threads/impossible-to-type-okee...
[0] https://en.wikipedia.org/wiki/Global_Industry_Classification...
[1] https://en.wikipedia.org/wiki/List_of_S%26P_500_companies
[0] https://www.proshares.com/our-etfs/strategic/spxt (S&P minus tech stocks)
[1] https://www.defianceetfs.com/xmag/ (S&P minus "Magnificent 7")
If you need to tick all of those boxes for every single byte of 20PB worth of data, you are working on something very cool and unique. That's awesome.
That said, most entities who have 20PB of data only need to tick a couple of those boxes, usually encryption/reliability. Most of their 20PB will get accessed at most once a year, from a predictable location (i.e. on-prem), with a good portion never accessed at all. Or if it is regularly accessed (with concomitant low latency/high throughput requirements), it almost certainly doesn't need to be globally distributed with tier1 access. For these entities, a storage cluster and/or tape system is good enough. The problem is that they naïvely default to using S3, mistakenly thinking it will be cheaper than what they could build themselves for the capabilities they actually need.
If those 20PB are deep archive, the S3 Glacier bill comes out to around $235k/year, which also seems ludicrous: it does not cost six figures a year to maintain your own tape archive. That's the equivalent of a full-time sysadmin (~$150k/year) plus $100k in hardware amortization/overhead.
The real advantage of S3 here is flexibility and ease-of-use. It's trivial to migrate objects between storage classes, and trivial to get efficient access to any S3 object anywhere in the world. Avoiding the headache of rolling this functionality yourself could well be worth $3.6M/year, but if this flexibility is not necessary, I doubt S3 is cheaper in any sense of the word.
Control theory is one of those things that shouldn't possibly work, yet here we are.
As I wrote in another post, if Musk had never purchased Twitter and Jack Dorsey performed the same reduction in engineering staff, I doubt the site would be materially different from how it was pre-Musk.
— Flunkies, who serve to make their superiors feel important, e.g., receptionists, administrative assistants, door attendants, store greeters
— Goons, who act to harm or deceive others on behalf of their employer, or to prevent other goons from doing so, e.g., lobbyists, corporate lawyers, telemarketers, public relations specialists
— Duct tapers, who temporarily fix problems that could be fixed permanently, e.g., programmers repairing shoddy code, airline desk staff who calm passengers with lost luggage
— Box tickers, who create the appearance that something useful is being done when it is not, e.g., survey administrators, in-house magazine journalists, corporate compliance officers, academic administration
— Taskmasters, who create extra work for those who do not need it, e.g., middle management, leadership professionals