I would bet to be ready before the Superbowl ads
163 karma · joined September 7, 2019
If I'm being honest, a lot of my professors (perhaps a big majority even) were just bad teachers and I got much more value out of the textbook, looking up stuff on the internet, or just tinkering with the at home assignments. I can say with 100% certainty that ChatGPT would have been infinitely more helpful in me learning calculus compared to the professor who taught my class in university.
I also don't really align with the issues he has with students asking for the slide decks used in class. If it can help your students learn the material, the whole purpose of the class, then what's the big deal? This point in particular almost made it seem like he's a bit salty over his students not being deferential enough to him.
All in all, despite doing many of the things that this writer takes issue with when I was in college myself years ago, I have a great career and I'm good at my work. So I think the kids are going to be just fine.
I've definitely had far more success with using AI as a fuzzy search or asking it for one-off pieces of functionality. Any time I ask it to interact directly inside my codebase, it usually fails.
Devin was pretty bad and honestly soaked up more time than it saved. I've tried Cursor Composer before and came away with bad results. I tried Copilot again just now with o3-mini and it just completely hallucinated up some fields into my project when I asked it to do something...
Am I taking crazy pills or do these tools kinda suck?
If 2025 is really going to be the “year of agents”, then they need to do better than this.
The grift has been at unbearable levels for months now and it actually drove me to delete my X account recently.
Yeah, that makes this result a lot less impressive for me.
“SO IS IT AGI?
ARC-AGI serves as a critical benchmark for detecting such breakthroughs, highlighting generalization power in a way that saturated or less demanding benchmarks cannot. However, it is important to note that ARC-AGI is not an acid test for AGI – as we've repeated dozens of times this year. It's a research tool designed to focus attention on the most challenging unsolved problems in AI, a role it has fulfilled well over the past five years.
Passing ARC-AGI does not equate achieving AGI, and, as a matter of fact, I don't think o3 is AGI yet. o3 still fails on some very easy tasks, indicating fundamental differences with human intelligence.
Furthermore, early data points suggest that the upcoming ARC-AGI-2 benchmark will still pose a significant challenge to o3, potentially reducing its score to under 30% even at high compute (while a smart human would still be able to score over 95% with no training). This demonstrates the continued possibility of creating challenging, unsaturated benchmarks without having to rely on expert domain knowledge. You'll know AGI is here when the exercise of creating tasks that are easy for regular humans but hard for AI becomes simply impossible.”
The high compute variant sounds like it costed around *$350,000* which is kinda wild. Lol the blog post specifically mentioned how OpenAPI asked ARC-AGI to not disclose the exact cost for the high compute version.
Also, 1 odd thing I noticed is that the graph in their blog post shows the top 2 scores as “tuned” (this was not displayed in the live demo graph). This suggest in those cases that the model was trained to better handle these types of questions, so I do wonder about data / answer contamination in those cases…
Essentially, the comment made the point that tech is advancing so fast these days that most people are unable to keep up with the pace of these radical changes. And the natural reaction to that for many is to reject these "advancements" or at least look upon them with cynicism and skepticism.
And when I’ve personally tried using it on my various Macs over the years, I’ve always encountered bugs and glitches on websites that are seemingly not there with other browsers.
To be honest I’m pretty unhappy with a few of Apple’s “core” apps. Music is another dumpster fire...
Essentially the core functionality doesn’t take very long to build out. But the final polishing, details, edge cases, and bug fixes soak up a huge amount of time.
I actually feel like the suggestions seemed to get worse during my month of using it for some reason.
Towards the end, it started suggesting these large blocks of code (another issue I had with the interface as well) which were very not relevant to what I was attempting to write.
All in all, I’m very underwhelmed from my first experience with “AI enhanced” coding.
I briefly considered going full-time into solo game dev. But once I got my first "real" job offer after college, I quickly let go of that idea.
Many years later, as a SaaS founder now, I have a strong itch to get back into game development. One of my dream goals is to some day exit my company and then comfortably/leisurely "retire" into a career as a solo game dev.
When a code suggestion is correct it’s nice but it honestly feels like a very rare occurrence so far.
What often ends up happening is I will get suggested a snippet that is close to, but not exactly what I need. So if I accept the suggestion, I end up doing a fair amount of editing anyways to correct the suggestion.
Even worse, occasionally I will accept a suggestion and only later notice a subtle mistake.
The place I’ve seen the biggest benefit is with writing comments or user facing text copy.
I see people on Twitter and Hacker News talking about how much their productivity is being boosted by Copilot and ChatGPT…
But I’m just left scratching my head because I’m barely certain I’m seeing ANY boost from either of these tools so far. I feel like I’m missing something?
But a lot of times, I'm just connecting black boxes and slapping a coat of paint on top (aka our branding). And it leaves me with this sort of guilty feeling that I'm not actually doing anything valuable.
Ultimately I still do it because the money is great and overall it's a very privileged position to have in today's world.
But I think this is where having a hobby project comes into play. I can do things "my way" and not worry about needing to use the most efficient or industry standard components.
I'm really enjoying Stage Manager so far as well.
This of course leads to a huge page with someone's life story interspersed with the actual cooking ingredients/instructions. It's so common to see some something like: "My mother used to make me this dish for me when I was a child and it's my favorite thing to cook in the winter time now, blah blah blah."
No one fucking cares! Give me the recipe in one concise, step by step list!