14,074 karma · joined May 6, 2012
So why in the world wouldn't I respond to this by automating away the hassle?
The solution for both sides is for the companies to implement support bots that have more power to address my problem than the humans they replaced were ever given. I have a feeling it's not going to work out that way, though. Maybe with a few unusually-enlightened organizations, but I'm not holding my breath.
At the same time, when I need to use the hardware for something, whoever is renting it from me at the moment is going to get unceremoniously booted, and I imagine they are not going to be happy about that. I assume that vast.ai's providers get uptime ratings that drive their work allocation, right?
Meanwhile, in the US, companies like Boeing, GM, and Intel will never be allowed to experience more than minor financial inconvenience before the government bails them out with protectionism, guaranteed loans, and outright subsidies.
I don't see a material difference between how the Chinese government treats their strategically-important industries and the way we do here in the West. Terms like "socialism," "Communism," and "capitalism" are just fodder for Fox News camp-followers.
The AI models we currently have still maintain their working state with a finite and laughably-small context window, but that is already starting to change. My .claude directory contains over 300 .md files that I didn't put there myself. Their contents are eye-opening. The question of who owns, stores, maintains, and can access that data is going to become insanely important over the next couple of years.
If you thought LLMs themselves were disruptive and contentious, just wait until the fight over object permanence gets under way. That's when owning your own box full of graphics cards is going to become important. My own bet is that I won't care too much about the electric bill or my opportunity cost when we all find out what the AI labs really have in mind, and what they're going to have to do in order to justify the valuations they're seeking.
TL,DR: it's not about the tokens, IMHO.
It's worth it, knowing that there are no rugs Sam or Dario or anyone else can pull.
So if you can spend $30K and immediately start mining $1500/month out of thin air, that's a pretty nice investment even if the electricity costs $200/month. Two years later the cards will have paid for themselves entirely and (I suspect) will still be pretty useful.
It does argue in favor of just paying OpenAI or Anthropic for tokens, though.
Not $400 a month, it doesn't. At least not around here (we average $0.12/kWh and I don't personally run my cards over 300W.)
And there's a lot of labour and effort involved...
Theoretically, the people who hang around HN are more likely than most to be capable of the labour and effort of setting these things up and maintaining them.
People don't even run their own email servers...
People don't run their own email servers because a convenient coalition of spammers, standards bodies, and large email providers have done their best to make running one's own email server almost impossible.
Interesting, you don't find that the model is perfectly capable of solving those on its own?
Or does it just refuse to try?
How do you think Trump has made more profit during his years in the Oval Office than he did in 30+ years of business before that?
And don't bother trying to claim that they cheated. Even if they did crib off of other mathematicians' notes, (a) that's how this is done; (b) those mathematicians were relying on AI as well; and (c) OpenAI resolved an aspect of the N-S problem that was not being addressed by anyone else.
One-shotting something like Pac-Man doesn't prove much. At the end of the day, one-shot fidelity is going to scale more or less linearly with model size/world knowledge. Why wouldn't it?
By what authority do you claim this? Your school of thought has a really shitty track record of late.
Your point about "predicting the next word" mostly means that your post was very easy to predict.
Well, it's not anymore.
There is if you ever want to negotiate a nuclear arms-control deal again. None of this would be an issue if Ukraine had kept their nukes.