Hacker News Reader

No.

Dunno but the AWS cost for your knowledge base would be comical.

Everyone with enough VRAM and data.

I know OpenAI describes the current costs of operating ChatGPT as “eye watering”, but I wonder how quickly these costs will start to come down. Improvements seems to be accelerating, and those improvements should be in efficiency as well as performance.

It seems like you have no real knowledge about what you are talking. If the last years told us anything especially with the bad performance of GPT-J and BLOOM we will see these models ballooning for at least 2-3 more years on the hardware side there is also nothing that shows that the costs will go down.

I absolutely have little knowledge in this area. I just know that the models have reached an entirely new level of performance based on what I see with ChatGPT and limited reading in recent weeks.

I’m trying to get a read on how things will play out over the next year or two. I’m bracing for big change and trying to get my head around the enabling and gating factors.

If you can point me to any articles/resources that would help with that effort, I’d appreciate it.

Reply on news.ycombinator.com