Hacker News Reader

It’s not “trivial” because of the cost per query. As far as Google, it doesn’t even have access to the most valuable phone users without paying Apple $18B+ a year.

View on HN

Something can be both expensive and trivial. If the market is huge they will bear the cost. The tech is well understood even now.

The parameter size will likely be an order of magnitude less for gpt4 level results in a few years

If the fixed cost was huge, you would have point. But the variable costs are also huge.

I’m sure the market is also huge for dollars sold for 95 cents.

it's really not that huge. unlike most companies, people are willing to pay if it's Apple. they can roll it into the iCloud subscription

That doesn’t help. You’re still making something that has a high variable cost into something that the user only is paying a fixed cost for.

I never said anything about the user only paying a fixed cost

So how well will it go over if the average consumer is nickel and dimed for every $x number of queries?

Not sure about "the tech is well understood" given the LLM itself is a black box in regards to how it works internally, even Microsoft researches admit it (Sparks of Artificial General Intelligence: Early experiments with GPT-4).

Reply on news.ycombinator.com