Hacker News Reader

That's cheap for an AI model training at big tech. Your average ads model engineer at those companies likely uses more compute each quarter.

It mostly suggests that we're in another AI hype bubble. MS and other big tech companies can easily replicate OpenAI results and do same type of research.

View on HN

Well, there's not only monetary cost on compute, you need humans interacting with it for RLHF, it takes time as well, you need engineers, and at the end of it, if you're just copying the leader, you're always going to be behind and not going to be coming up with the latest and greatest.

I'm just disappointed the compute cost alone seems difficult to surmount for open source/community projects.

The number of companies ready to spend $40M/year of compute per "average ads model engineer" is exactly 0.

I know of 1 at least...

'compute' costs are tricky to convert to dollar values - everyone does it at 'what would it cost to rent this from AWS', but the reality is, people like AWS are prepared to give low priority access to unsold compute for almost any project.

Reply on news.ycombinator.com