5,589 karma · joined December 23, 2021
I am far left, a christian socialist, disabled, autistic, prison abolitionist, recovered addict, formerly incarcerated, and spent many years homeless. I am significantly older than I take the median to be on this site. I often post from these perspectives, which generates a lot of comments to respond to. My views are extreme but I try very hard not to troll or flamebait. I do make jokes but if it seems serious chances are I am sincerely representing my view.
This is draining and sometimes I end up using my handful of permitted daily comments on something less serious. I try to remember to come back around the next day but often forget.
With prose fingerprinting, sophisticated tracking, now your identities are only separate by rapidly eroding social convention. Intentionally merging them allows you to have control over the process, and helps you maintain discipline about what you reveal where. If you don't do it it will be done to you.
The second part is an emerging convention but it's fairly common from what I've seen. IDK maybe no one will be reading or writing code in 18 months but if they are we'll need to separate these two things.
Secondarily but probably more importantly: it's real easy to read something and say "yep I understand that." It's a lot harder to fool yourself when you have to actually write down, with your own brain, what that thing you read does. If you're not doing this you must have incredible discipline elsewhere to make up for it.
But I do think what benefits LLMs is the speed and accuracy of feedback. Type systems cover the accuracy part, but haskell was killing them on speed. It seems like a strange choice to go so far the other way on accuracy when there's a lot of languages in between. But I'm not familiar with the project so not in a position to call it.
It's not also really about expressiveness IMO. I've found LLMs to be best with more constrained type systems: they are better at ocaml than they are at typescript.
Why certain approaches didn't catch on until recently, or ever, is an interesting thing to think about but "we didn't know how" is not the story here.
Not every day, maybe not even every month, but I've faced plenty of problems I was well equipped to solve directly because of the formal study of them.
Or like look at that corner of northern indiana. That's the part of indiana that is part of the chicago metro area. Makes absolute sense to avoid cross-timezone commutes.
Northern michigan is pretty damn far north! Winter sunsets up there would be before 4pm on central time. Makes sense for them to shift it permanently.
I think they probably all make sense if you know how to look at them right.
Kris Kristofferson was writing songs about the petty cruelty of cops in 1970. Fuck tha Police was released almost 40 years ago. Richard Wright published a novel in 1941 about a man who was tortured into a false confession by police.
The technologies are new and powerful but that's not the issue. The issue is that police are themselves lawless scum who will use any tool at their disposal for whatever harm they feel like inflicting, to who they always inflict it on. We should stop giving them new tools, absolutely. But we also have to stop them.
Many will also not want to tell you any stories about what their family did in cuba.
Like I'm not trying to downplay the real violence and excesses. But read about how americans talked about cuba pre-castro, what they expected from the place during batista's dictatorship.
The deeply entrenched feudal-type rural poverty provided the raw human material for the mafia to create a vile playground for their own fantasies and sell it to other wealthy americans. Epstein economy shit. Castro didn't come out of nowhere, he harnessed the deep disgust and pain of a people being treated as things for money and pleasure. So yeah the sugar plantation landlords, the batista enforcers, the mafia sex slave sourcers were running for their lives. A lot other people got caught up too, absolutely. But ask your hypothetical cuban immigrant some followup questions. It's not always exactly personal why they hate castro.
I am actually writing a paper on this right now so nothing I can point you to yet but yes. LLMs are better (produce working code in fewer attempts controlling for the relative size of training corpus) when using type systems with inference and global unification. It is largely about the quality of the error feedback channel so languages with very good compiler errors (accurate, localized, include the correction with the failure) can close a lot of ground.
But inference + sound type system gives you a constraint propagation that genuinely restricts the ability of the LLM to get into trouble. Type systems that require annotation give up most of the benefit, since the annotations are themselves surface area for LLM mistakes. Unification also puts heavy limits on the expressiveness of the language which is a confounder and may actually be a big part of the benefit too.
Everyone has been on the "the training data is better" thing but I actually don't think so. All of the languages that people report as being better because of good training data actually have fairly restrictive type systems. Elixir is an exception, but it has exceptionally good error messages! And also, along with erlang, pretty unique runtime semantics that may contribute but that's outside my domain I'm on type systems. Debunking the training quality thing is not what I'm working on but I have deep suspicions about that common wisdom.
Are we on the same site? Is anyone writing about anything else?
There's a sweet spot of complexity for low importance tasks where it's just big enough I don't want to do it and just simple enough to have opus plan/delegate/review with another model. So possibly model improvements will grow this window, but currently I don't do much in there.
Man idk, it's not how I talk but there's like 100 million nigerian english speakers, twice that indian, and they have some speech mannerisms that surprise me the first few times. I'm pretty sure I've heard exactly this from a colleague before.
Intuition about what a native speaker would do with english are scrambled right now. I'm not even sure most english is spoken by native speakers anymore, and the boundary between a native speaker and someone who has "merely" been using it as their educational and professional language for their entire life is disorienting.
I'm not trying to put all of the blame on individuals responding to the pressures being applied to them. But neither am I accepting their abdication of the responsibility to act with honor and courage in the face of those pressures.
Why? Operating a successful business should be remunerative on its own, or else it's not successful. Owners who don't want to do it anymore can let it become worker owned. If they don't want it, it can dissolve. What else do you need? The very concept that the end of a successful business is a big payday for its creator is itself the poison here. There is no end just another workday, success is ongoing not final. This is natural and correct.