4,057 karma · joined May 31, 2015
I don't represent anyone and no one represents me
I have a thousand names
Since this place doesn't have DMs, I set up an email for this username at tuta (dotcom)
Despite the fact that people keep insisting on the buzzword "AI" to describe these large neural networks, they are more succinctly defined as approximate computer programs. The means by which we create them is through a relatively standardized family of statistical modeling algorithms paired with a dataset they are meant to emulate in their output
A computer program that's specified in logic is already a usable representation that can be used to understand every aspect of the functioning code in its entirety, albeit some of it may be hard to understand. You don't need to consult the original programmer at all, let alone read their mind
In contrast, a function that is approximated in the manner described needs the training data to replicate or make sense of it, and in fact is even necessary to assess whether the model is cheating at the benchmarks its creators assess it against. The weights themselves are a functional approximation, not a functional description
For the purposes of the ethos of free and open source software, it is obvious that training data must be included. However, this argument is also deployed in various other places, like intellectual property disputes, and is equally stupid there. Just because we use the term "learning" to describe these systems doesn't mean it makes sense for the law to treat them as people. It is both nonsensical and harmful to say that no human can be held responsible for what an "AI" model does, but that somehow they are "just like people learning from experience" when it benefits tech companies to believe that
Like look, I get how people get so attached to this stuff. I've got a high enough IQ score to be beyond the statistical sensitivity of Raven's Progressive Matrices which mostly seems to mean that I'm great at test-taking and puzzle-solving, and I get that IQ seems like this really powerful explanation of variance on vibes from an internal perspective. It feels like people above a certain point on the curve are just so much more vibrant and curious sometimes! But I've come to believe that this is more an artifact of how we shunt certain people within the education system than some deep difference between people on some generally-applicable measure of capability. Lots of social science theories about assortative mating and such seem to observe that people with brains that work similarly will also tend to like each other more, and we have vast edifices that determine other socialization-determining factors based on these kinds of heavily-correlated metrics.
I do however think this leads to a lot of problems when those companies try to protect their business models, as we are seeing a lot of today
The messaging of companies in regulatory cases has become rote and predictable as the sectors they occupy have grown more concentrated. There is no reason to heed it at all in the present environment
Generally speaking, the sad truth of a complex economy is that coordination is hard, and there's usually a short-term privatized gain to be had by someone willing to poison the future and the commons. No amount of benefit to humanity overall or even the specific society such a person lives in will convince a person who simply doesn't care about anyone else. Fortunately for humanity, a very small minority of people actually operate like that. Unfortunately for humanity, some of them have managed to accumulate a lot of power
If Kellner wanted to make a deal with cable subscribers, why didn't he advertise cable that way? "If you buy our package and agree to watch ads when they come on in order to support our monetization model, you can watch over a hundred channels!"
But he didn't do that, of course. Instead, when his business model clashed with reality, he blamed the customers for violating an imaginary contract they never signed. Just because execs want to imagine violations of their assumptions as crimes doesn't mean that they actually are, and we should be using every meager lever of power we have access to to prevent governments from making laws to appease people like him, because every time a law like that is made, more people's rights are made subject to the arbitrary retroactive demands of delusional businessmen
You're keeping charts, right? I wanna know what the top hit on that block is next month
As an editor it's a pain in the ass, as an ecosystem it feels like a fucken freemium mobile game for how polluted and nickel-and-dimey extensions are, and worst of all it's owned by microsoft so while this article is informative on the specifics, I knew from the jump there was some legal fuckery involved because there literally always is
I can't be a total purist and never use a tool that's connected to a large tech company's ecosystem, but where at all possible one should, and this is only becoming more true
From an ethical perspective, you will never convince me to feel bad about any "theft" of this kind, and this kind of dilution of concepts like "theft" and "crime" is likely responsible for the emotional valence of those terms reading a lot less significantly negative to people
As a creator of any kind, I think that simply relying on LLMs to expand your output via straightforward uses of widely available tools is inevitably going to lead to regression to the mean in terms of creativity. I'm open to the idea, however, that there could be more creative uses of the things that some people will bother to do. Feedback loops they can create that somehow don't stifle their own creativity in favor of mimicking a statistical model, ways of incorporating their own ingredients into these food processors of information. I don't see a ton of finished work that seems to do this, but I see hints that some people are thinking this way, and they might come up with some cool stuff. It's a relatively newly adopted technology, and computer-generated art of various kinds usually separates into "efficiency" (which reads as low quality) in mimicking existing forms, and new forms which are uniquely possible with the new technology. I think plenty of people are just going to keep writing without significant input from LLMs, because while writer's block is a famous ailment, many writers are not primarily limited by their speed in producing more words. Like if you count comments on various sites and discussions with other people, I write thousands of words unassisted most days
This kind of gets to the crux of why these things are useful in some contexts, but really not up to snuff with what's being claimed about them. The most compelling use cases I've seen boil down to some form of fitting some information into a format that's more contextually appropriate, which can be great for highly structured formatting requirements and dealing with situations which are already subject to high protocol of some kind, so long as some error is tolerated. For things for which conveying your ideas with high fidelity, emphasizing your own narrative voice or nuanced thoughts on a subject, or standing behind the factual claims made by the piece are not as important. As much as their more strident proponents want to claim that humans are merely learning things by aggregating and remixing them in the same sense as these models do, this reads as the same sort of wishful thinking about technology that led people to believe that brains should work like clockwork or transistors at various other points in time at best, and honestly this most often seems to be trotted out as the kind of bad-faith analogy tech lawyers tend to use when trying to claim that the use of [exciting new computer thing] means something they are doing can't be a crime
So basically, I think rumors of the death of hand-written prose are, at least at present, greatly exaggerated, though I share the concern that it's going to be much harder to filter out spam from the genuine article, so what it's really going to ruin is most automated search techniques. The comparison to "low-background steel" seems apt, but analogies about how "people don't handwash their clothes as much anymore" kind of don't apply to things like books
It isn't. The majority of tech companies are speculative and funded by venture capital, and what's worse, many of the largest companies, which actually do generate revenue, are monopolies
What this means is that efficiently competing is only a viable strategy if you can convince a small pool of potential investors - many of whom think "competition is for losers" - that it's a good play, while also avoiding being bought out and crushed by one of a few trillion-dollar companies
The dynamics you're describing are those of an open market, and with wealth disparity at an all-time high (so your customers have less influence on average) and financial scams fairly rampant due to decades of lax enforcement, most companies right now are not effectively operating in an open market
Buying SaaS is trendy conventional wisdom. It has benefits and downsides, but in my experience the biggest benefit is that VCs think it's smart to do and also often benefit from a company buying the products of other companies. Whether it helps with things like making products faster or better overall is close to immaterial in this environment
As far as my job hunt goes, I'm not finding myself rejecting positions out of disappointment, but noticing that I'm often rejected by C-suite people after being technically vetted, often after having what I believe was a pleasant, positive, and often even generative conversation about what the company's plans with AI are and how I might help accomplish them. As I said before, I really do try to stay positive, and I think when putting my best foot forward, like in a job interview, I tend to succeed at that, but my experience leads me to be more negative about this moment in the industry when I am more candid, such as in this forum. I think if you're going out for work in whatever the tech bubble du jour is, the people you're talking to have really different biases and expectations from those hiring for more "boring" development jobs, in a way that makes me want to just go out for more general roles and lie low for a while, except that since I've been working on primarily ML-related projects for most of the last decade, it's also hard to convince people not in that area that I have adequate relevant experience. In this context and with bills to pay, it's hard to stay optimistic