We overpay for healthcare because we must pay, and it has institutional and natural bottlenecks which restrict availability and choice.
11,807 karma · joined May 13, 2015
We overpay for healthcare because we must pay, and it has institutional and natural bottlenecks which restrict availability and choice.
A big enterprise can drop one (or 4) of these on someone's desk and let them go nuts.
if they are a heavy user, perhaps they string 4x together.
The advent of factories with limitless and constant demand for labor is a new development of the industrial revolution.
At the investment scales being discussed, CUDA/architecture and other advantages do not matter - you could spend 1 billion on building a new chip architecture. The ram/fab inputs have been a commodity market for years. Heck, even the model bottleneck doesn't seem real when it's only 1-4 billion or less to get a state of the art model.
At some point the compute bottleneck will be relieved, you can see NVidia hedging their strategy with both open models and on-device chips targeted for local inference. The 200 dollar a month plan will absolutely be taken over by local hardware in the future.
If a time traveler went back to 1600 and started spouting off about differential equations everyone would think them quite mad.
Take that data / training recipe and scale it up with compute to see what happens?
It's trivial to rent all of the above components in a competitive market under different periods, you may simply rent the token output from someone who put in the effort on this as well.
An open frontier model induces margin compression on training and inference prices across the industry.
As part of due diligence, the buyer/investor should ask how these numbers are calculated and make their own judgement. Unfortunately I believe startups select for those who dance the border of deceptive and foolish.
The result was “seizing the means of production”
That the US decided to expend it's precision weapon stockpile on a conflict of choice with no ground or dumb bombing campaign to fallback on is a mystery for later generations. It is not unbelievable that Iran is capable of blocking a dumb bombing campaign indefinitely, or that the viable targets for such a campaign are politically untenable.
Are there re-usable query primitives for extremely large scale multi-modal data? how do you scale such queries or make them efficient?
The list goes on.
A "research" arm is exactly this license, although it comes at the cost of potentially killing innovation in the rest of the company.
I have no interest reading someone else’s ai output that has not been verified.
Having these models in the open caps the inference margin.
If there is really only a few dozen people doing the buying and the selling at the top on a weighted basis, then the prices are whatever they convince themselves of.
If 50 billion in revenue is from other companies debt spending… then You have a problem.
Why couldn’t any well capitalized firm get to a leading position?
The 5.5/5.6 series has performed quite well however. My guess is that my use cases stop aligning to swebench pro around 50% accuracy, and more closely align with DeepSWE.