Yes this would be very useful. Or at least being able to selectively compact a linear part and continue from before.
Often times I just sort of wish to undo.
1,005 karma · joined February 8, 2023
Often times I just sort of wish to undo.
But Work gives the model a computer instance it can use for programmatic data access, API munging, etc.
Success cases I’ve had: chat - read the reports in my Gmail and put a counter proposal together.
Work - cross reference all the options with commute time using traffic aware map data. Ground it on drop off / pick up times from each option’s stated rules and hours. Create a table with commute and idle time break downs.
Did the rise personal computing make data centers and super computers obsolete?
Any advance in inference that allows local models to do the job will also benefit hyperscalers. Imagine the sheer amount of compute they could throw at problems if each 32GB of VRAM was enough for frontier reasoning.
It’s worth it. Already saved me more than $30,000 in a business transaction by negotiating for me.
I’m not going to use a CPA in the coming tax seasons either. I’m determined to not pay for any white collar labor if I can avoid it.
Meanwhile Claude and Astra like to couch all their agreements with caveats and provisos.
I would really appreciate your input!
I wish this letter could be more egalitarian and include the view points of those who AREN’T the beneficiaries of a highly competitive winner-take-all system.
Since the common narrative is that AI frees up labor to do other things (engineering -> trades), maybe we can celebrate that genius mathematicians will now spend time teaching children how to be as smart as them?
That half a million total comp is the consolation prize for the disillusioned.
The gatekeeping in math academia is extremely unfair, or should I say objectively fair but personally unfair. I won’t cry crocodile tears.
I don’t think a chess engine is an apt analogy at all. In a chess engine, there is a concrete search tree and although it emits one move at a time, it’s actually picking the entire branch (of course, with iterative deepening as the game progresses).
There is no obvious place in transformer models where the entire trace was already computed prior to a single token being chosen. It’s possible, maybe even likely, that the whole trace exists internally as activations. Multi token prediction and diffusion adapters point to that being the case. But to my knowledge no explanation has been given for where in the model the future plan is stored.
Wiles’s proof will remain a mystery to me.
Some kind of Lê Chatelier principle applies where if everyone has access to AI then its value is actually diminished somewhat.
Well by that metric humans aren’t intelligent either!
And how many people could’ve actually invented calculus, relativity, quantum mechanics? Are those who didn’t and couldn’t also not intelligent?
15 years ago if you were the sole proprietor of these models, would you be able to hold a dozen remote junior engineer jobs? Maybe even more? These models could certainly pass all interviews with flying colors and even survive independently in a company role.
I think sole ownership of AI 15 years ago could be worth north of $10 million per year. Just as rank-and-file employees.
Might as well drop all the pretense of “bringing your whole self”.
And besides, there is only time enough for ONE Mozart in the world.
As much as I like the speed and interactivity, I really don’t trust it
Only one of those capabilities can actually deliver kinetic solutions. Meanwhile big tech revenue is delivering ad solutions.