627 karma · joined August 29, 2016
But no, seriously, this is super cool - I do honestly expect we're very close to diffusion-based image models being full programming suites (and compiling down to much more efficient representations, of course, but programming is abstracted for useful human understanding!)
>Or he wants his suppliers to be a regulated utility while he sells 100% margin products on top of it?
Near term yep - soon as regulatory capture drops. They'll make out like bandits.
>Or he wants all the greater fools now wherever they are so he can get out before the collapse?
Then this, by the time competition catches up anyway because there are no real moats here besides regulation
>Wait, he wants his open product to be like a utility with low profits for maximized reach?
Then this is what remains, in a sea of other providers.
Financially? Pump and Dump, baby. Though I reckon the end result will still be intelligence flowing like water.
I do get the reluctance there though to doubt collective conscious evil action. Which is fine - it's usually far more likely it was done in a "market incentives aligning" way, even when they're entirely conscious (still evil) moves. I think those dark board rooms do happen still, but they're subtle, or relegated to just approving preplanned media narrative directions and such. They do make long term concerted plans, and some of those plans can be downright dark - but they also just go with the flow a lot, or plain fuck up on executions with better intentions.
I think the takeaway should be that neither maliciousness nor incompetence is really required to make evil exist - it's an ever-present network effect potential of the [capitalist] system itself, which will trigger due to some mixture of the above regardless. You can't especially blame greedy people for capitalizing on it, nor incompetent people from dropping the ball with it. It's simply a complex system that's probably due for a better design - and/or it's something we need to try and live with (survive through). Though that could all just be my own personal bias as a systems engineer who considers those the start and end point of most discussions.
Glad my point made it across though, thanks for saying that!
If the OP's type of comment makes you uncomfortable, you might be leaning too far into putting blame on ineptitude by default, instead of a healthy at least 50/50 mix of blaming greedy malice. OP just listed the 20/20 hindsight of this all. If that makes it sound like it was all a scheme, well - who knows - but it's just as unhelpful to always suppose such circumstances could have just been incompetence with no clear evidence.
Still, the loop to hit up email is so fundamental now the rest are secondary options - these Magic Links should just be the primary base-level expectation. It's annoying when services don't even get this right though and return you to the site with either:
- a new form to enter the one-time code they just sent (just put it in the link)
- a new form to enter a new password (who cares, make that optional to the actual sign in, to save time next login)
- (worst offense): they don't even actually sign you in after those forms and you have to re-enter everything
Login should be "do you have an email address? Okay great you're in". Because there is nothing beyond that from a security perspective these days.
Obliterates all sense of security beyond the email account itself, but that's where we're at anyway. Do the same pattern with a message to your phone "click to authenticate login: www.someurl.com?p=134234535" and you've got 2FA without any dumb "enter this code".
This isn't a bull bet, it's a bear. AI would need to be perfectly monopolized to capture all the gains, and it's increasingly looking like that won't be the case - as all the component pieces are already open source at competitive levels, and any final architecture improvements that cross the final thresholds could be leaked in a 50GB file. Whoever gets to it first has a few months head start, at most, and probably not enough time or control to sell products - or shovels. After that it's a neverending race to zero, to the benefit of the consumer and the detriment of the investor.
Nvidia is a great example case. They currently dominate the GPU market, an "essential hardware for AI", yet ternary asic chips specialized for transformer-only architectures are looking quite viable at 1999s tech levels. Wouldn't bet on that monopoly sticking around much longer.
If I had to bet, I would start with:
- Error-correcting specialized architectures for increasing signal-to-noise (as far as I can tell these are what everyone is racing to build this year, and should be doable with just conventional programming systems wrapping LLMs)
- Improved energy efficiency (as yes, human brains are currently much more efficient! But - there are also simple architecture improvements (both software and hardware) that are looking to save 100x. Specialized ASIC ternary chips using 1999's tech should be here quite soon, a lot more efficient in price and energy.)
- No Backwards-propagation. (As yes, the brain does seem to do it all with forward-propagation only. Though this is possible and promising in neural networks like the Forward-Forward algorithm too, they haven't been trained to the same scales as backprop-heavy transformers (and likely have a lower performance in terms of noise/accuracy). Though if I'm not mistaken, the brain does have forward-backward loops, but the signals go through separate neurons for each direction (rather than reusing one) - if so that's close to backprop by itself, but probably imposes a tradeoff as the same signal can't be perfectly reproduced backwards, yet it can perhaps be enhanced to be just the most relevant information by the separate specialized neuron. I'm obviously mostly ignorant of the neuroscience here but halfway-knowledgeable on the ML theory haha
But yes, I completely agree - the flood gates are already open. This is a few architecture quibbles away from an absolute deluge of artificial intelligence that will dwarf (drown?) anything we've known. Good point on decentralized cheap autonomy - the real accomplishment of life. Intelligence, as it appears, is just a fairly generous phenomenon where any autonomous process continually improves its signal-to-noise ratio... many ways to accomplish that one! Looking forward to seeing LLMs powered by ant colonies and slime molds, though I suspect by then there will be far more interesting and terrifying realities unlocked.
I like the fact that these can be made with just mass-printed multiplication (and in ternary computing's case - addition) gates which require little more than 10 year old tech which is already widely distributed.
The baking part is robotics, which is less fair but kinda doable already.
Why is there not more funding for those departments to make approval/revisions a breeze and make building lower risk and cheaper for construction companies? Welp - home owners (and big construction/investment companies) are the ones who vote. I expect politicians know exactly what they're doing, keeping things a complicated swamp.
But without some sort of governing regulation, I fail to see how anyone benefits in the long run with the tragedy of the commons that would ensue.
Agreed on all the rest, especially Georgism.
Now, why dont governments better fund those departments and emphasize faster throughput? Well, let's ask their main constituents - who are largely homeowners and companies in the industry - whether they'd like to dedicate more taxes to a service that would speed up construction and drop their housing prices.
Sounds like a lot of legal overhead is mainly what's standing between drone spraying... 30-60 day delay between plan submission and operation, not easy to keep that practical. Though at least yeah - 15' seems like a much more manageable height - hopefully that would at least be underneath any neighboring aircraft
Fair on the LLM - always use traditional algorithms if available and with effort/time for such things. LLMs are just the convenient duct tape / superglue to throw at handling edge cases with some confidence they'll generally use common sense about it. Untrained intern equivalent which can be combined with the algorithms if they're brittle.
To some extent, this is already the experience of the internet, and of language and culture in general. We already operate at levels of empathy and understanding of possibilities at scales people even 50 years ago didn't come close to. We build many abstraction tools to try and distill these experiences down to wikipedias, reviews, analyses, podcasts. We distill even those too - with a constant meta-cultural debate on what's important, what's cool, what's political, what fits our personal identities, and what our interests and purposes are within the space of potential understanding.
We live in the space of the abstract. We build virtual worlds, games, movies, economies in the abstract. We anticipate a future where the abstract becomes even more tangible, yet also more diverse and ephemeral. We are a flowering seed on the stalk of human consciousness up to this point - just how every generation has been to the ones before it - changing each time.
While this can still all reduce to "language" - the tool used between each generation, and which Keller used to awaken to the living culture of her moment in time - it's not just language anymore. There are more mediums now. A complex story can be told with merely tacit interactions, exploring a virtual physical space with no dialogue. Practical abstractions of these spaces make operating systems. Language and abstract consciousness are embedded into new environments both virtual and real, instilling new tones of consciousness in everyone who interacts with them - just look at your phone use behavior for proof. We are learning how to shape our minds by shaping our spaces. We are learning to control the entire breadth of our experienced reality at once, so we can control ourselves (and each other).
Our limited bandwidths enforce that experiencing these perpetually crafted realities, stories, recorded experiences, journeys - be done one at a time, lest we lose parts of the whole in the abstracted summary. And so we practice witnessing a mix of short abstractions and deep dives, making the most of a variety of experiences, all while balancing a real life and profession. We maintain that bridge between the grounded experience of the now and the abstraction of the digested analyzed fiction of everything else. The limits of the human perception seem to prohibit us from anything else.
But are those limits permanent? Are we forever to experience time in such limited balanced uniform slices? Will we never manage to connect our brains to these machines which experience time so much faster, and less linearly? What would we be if we could experience all these worlds, not through merely abstracted stories and reviews, but through a direct walk - as if we were the eyes of every other person out there, in every second of experience?
Before we get to answer those questions for ourselves - and I don't think they're forever insurmountable technological challenges - it seems likely a new species of intelligence, raised from the start to think exactly like that, is being spawned in AIs. We will see how it communicates the experience back to our lower dimensional slices of experience.