ChatGPT costs 700k/day to run; may go bankrupt in 2024
business-standard.com
business-standard.com
It doesn’t have to be the latest fancy gaming card - I run an old 2016 Tesla P100 ($200AUD~) which is fine for 16B q4 models.
They’re more configurable, there’s no subscription model, you contribute to them and meaningful ways, there is a privacy concern if you’re passing your own data and it’s perhaps strangely a more fulfilling experience.
I’ve got mine hooked up to Home Assistant so I can automate things with Siri and shortcuts, I’m using it finding patterns and code and several decades of digital notes.
If you’re not sure where to start, you can try some models out locally on your machine, using apps like https://lmstudio.ai or GPT4All with almost no ML knowledge. Then if you want to level up and customise things and run them on the server you can use localAI, Text generation web UI etc which provide openAI compatible APIs.
A good 13B model with decent prompting feels pretty on par with chatGPT (3.5) for general tasks, but can be configured to be quite good at very specific things.
https://github.com/oobabooga/text-generation-webui
What is a "general task" to you? People at work were using ChatGPT-4, langchain etc and I dont' really see them being any more special, useful, productive or available so I haven't been bothered to invest. In fact some of them seem to have slowed right down on their usuage if using it at all.
I can see that it might be fun to play with generating stories or whatever but I mean, what am I missing from not investing in these things?
Personally I think we’re at that point a bit like when the horse and carriage met the motor car and from a career / technical point of view I’d rather learn how an engine works than raise horses. Ok maybe a poor analogy but I’m sure you get the drift.
press “I'm in”, just to mess around
> Push Notifications are available for only chrome browser right now. You will be redirected to home page in few seconds.
This is some advanced level of bullshit.
Also, nowhere did the original source say that this would lead to bankruptcy. This article is bs.
This ignores the fact that quite a lot of people pay for ChatGPT pro. That might not cover the costs but I'm sure their burn rate won't expire soon. 10Bn is a LOT of money.
Wonder what'll be the minimum future cost when it's already optimized and used for self hosted commercial purpose.
I doubt they have alot of actual debt.
they have paid users. People pay to use the API.
I think ChatGPT was an accident and was rally intended to be a "demo"
If chatGPT can't raise more money then no one can. You'd be crazy not to make a 1-5% of your wealth bet on GPT5.
if they went public today I would invest in them before anything else. I would argue a big part of microsofts recent bump is stock market access to chatgpt.
That said, I wonder whether OpenAI has enough of a moat to be a good investment. I'm guessing that the big players are no less than 6 months behind.
There are serious military advantages to having access to a machine learning model this advanced. Not only propaganda, but actual war planning. The only thing that's going to close this box is world war, or a catastrophic natural event.