It's a wonderful project. Even small amounts help. Thanks!
2,416 karma · joined December 7, 2022
It's a wonderful project. Even small amounts help. Thanks!
It is surprisingly offensive.
The only friction for me is the general expensiveness of trying out top tier models, eg OpenAI's Fable equivalent (Sol?) to run for a trial period. I'd like to see a like-like comparison, eg buy x20 on OpenAI and see how much Sol i can use, how well it works, etc.
edit: Though surprisingly Claude seems to think Codex doesn't have hooks? That'll be tough, i use Claude hooks quite a bit.
Faster iteration means i mentally checkout less and am more involved with the code being created.
My hope is that in the far far future, we can get LLMs so fast that i can work in my IDE like normal and the LLM will just be an extension of autocomplete. I can state a goal, rough out functions, code, etc, and it'll just work around me like a very fast pair programmer / autocomplete.
The chat interface is an intermediate step that frankly i hate. The faster it is the less i wait.
Now for vibe-slop i'm making on the side, yea i don't care about speed. But that's not something i'm employed to do or anything i truly care about. It's a different workflow entirely.
I’m not offended by that because I’m already maximally offended lol.
My point was that i feel like humans have these two aspects, the ability to have a fact, and the ability to have a signal to the facts strength. I propose that as an explanation why we can internally analyze our understanding and come to a conclusion that yes, we do "know" it.
We also at times can't figure out how we "know" it, either because we've made up a detail (filling in blanks, assumptions, etc), or because we forgot where we embedded this detail. The lower the signal strength of this validation the more we can be unsure about a "fact".
I feel like LLMs are one half, but not the other. They effectively need a RAG for all of the knowledge they have, and if the counter for a given fact/idea/etc is low enough, then it's an low signal.
The question i have is how to do this efficiently. Of course i'm just speculating too, i don't know any of this.
Now is that because 4.8 is nerfed compared to 4.6 and thus more token efficient? No idea. I just know on x20 with a pretty plain workflow i struggle to use my tokens every week.
A worse product could win right now if it simply does as its asked.
It’s feeling quite similar to why I distributed out from google all those years ago. I didn’t want a hugely important centralized google account to be banned and cause friction to various aspects of my life.
The ability for LLMs to more easily catalogue user behavior and intent is going to get more interesting. Weird days. Feels like anyone could become a Facebook level metadata hoarder.
In that silly example/thought, the LLM would effectively need the ability to query the strength of a fact/spatial region/etc.
Right now i believe the LLM is more just the output of those weights. It has no way to inspect the strength of the signal. Eg it doesn't know if blue in "The sky is <blue>" is a strong or weak signal, it just predicted that next token.
If we could somehow encode strengths along with every token, eg "The sky is <blue:1.0>" or something we could perhaps give it a sense of [un]certainty. Though i imagine it would look differently than that since we'd want to encode this information in some sort of multi-dimensional space, rather than purely by token - since tokens aren't that valuable. Eg the "knowledge" in an LLM goes beyond tokens, and so too should signal strength.
I'm of course speculating on all of this and i have no clue on anything.
It obviously breaks down with humans too, given we so easily hallucinate and confuse things we "know". However i still suspect we're more reliable at probing information we've experienced vs not. Even if the case of poisoned knowledge, eg a crime scene accidentally implying information to a witness that the witness doesn't actually know, we still "know" that poisoned information via incorrect inference. Ie we "experienced" it.
Wonder what architecture would allow for this style of information/weight probing for an LLM.
It's a great example of a project that needs accountability, but there's also thousands of other projects that need absolutely no accountability.
It's all relative to the stakes. The lower the stakes the less informed verification is needed.
The real trick is being informed enough on the boundaries to know where it matters. In the construction analogy, you need to be informed enough to know that a house is a bad idea since there are safety concerns. However building something small and non-load-bearing is probably fine to "vibe".
Eg there's no expertise needed to judge a garden trellis or 2 foot picket fence. It either works or it doesn't, and if it fails down the road there's no harm.
This boundary knowledge is the important bit imo.
What I’ve learned is quite minimal due to the slop nature. However I’d have never even started this project in the past due to time, so it’s still fun being able to learn small bits of projects I’d otherwise not even touch.
No idea if zero AI/bots is even possible, but at least an attempt would have me interested. A platform like Reddit/Digg of old, offering human connection, features aimed at less toxicity, etc.
Instead they give us this AI crap :s
I know it's more mixed and complex than this, but i think a big opposition is not to the data centers themselves but to their locations. Too often it feels like the centers are exploiting local resources and community infrastructure rather than paying their share or locating themselves in places that are less likely to cause problems to home owners.
The whole process feels indifferent or even adversarial at times.
I feel like chat agents are missing the ideal UX, especially with the shortfall of their competence. Having to explain, rather than show, the agent feels like the wrong default UX.
Glad to see someone else exploring this space too!
Would you elaborate? Not sure what you're describing
I don't think i'll want to "hand off" code for several years, and so reviewing and iterating is becoming my #1 interest. A model that's as capable as 4.8 but 10x faster would be amazing for me.
Normally i'm first in line to try new models with Anthropic since i've clearly favored Claude in my personal tests, but this time i just don't think i care. 4.8 is capable, and even if the new one is more capable i don't want it to be slower (assuming it is). Note that i also (almost) use exclusively 4.8 on Max effort, so that also affects my speed comments.
I almost left apple entirely over those stupid switches lol.
I'd be fine with it doing that if it actually opened what i listen with. The OS can clearly see i spend 100% of my time in another music player (Spotify), opening Apple Music is at best a poorly designed UX.
I have a more hopeful take. As AIs improve and get faster we can more quickly and iteratively improve code which we may have historically avoided due to the work involved.
I know i've made several refactors that would have otherwise been insane lifts. Not only because the work involved but because sometimes you don't know if it will work, and so you have a sort of double friction; you don't know if it will even succeed. With an AI you can just throw it at the refactor to see if it runs into a problem all while you're having a coffee break or w/e.
In general AI is going to enable humanity to be more extreme versions of itself. For good and bad. I suspect more bad than good, though.
> Take the Unc Test and find out how cooked your aura really is.
Okay, as i get older i run into more of these scenarios where the new lingo is mostly beyond me. However this is not a complaint, if anything i'm more confused at how i grew up hearing "it'll happen to you!!" doom and gloom over frustration of youth lingo, yet i revel in it.
I find it fun in the way that new languages are fun, minus most of the work. Usually the new phrases are just a new word or two, far from the effort of learning a real new language.
And as a bonus you can then use the new lingo and make the youth groan out of second hand embarrassment. It really is a joy that i don't get why my older folks from my youth didn't enjoy. Then again i have zero concern about getting older (beyond health decline of course), so maybe that's the root of it.
Regardless, i bet i'm Unc. Lets see.
edit: Unc Score: 30, Soft Unc
- https://web.archive.org/web/20260602130637/https://www.techn... - https://web.archive.org/web/20260520190620/https://fortune.c...