hah, sorry, we are plebs out here.
1,295 karma · joined December 10, 2024
hah, sorry, we are plebs out here.
A lot of debris waiting to happen in data-center debt for sure. The next several years are going to be interesting with more of these type of blowups. This is a canary in the ai-wreck coalmine.
A barometer of the mania and one for the history books. A 23 year old wunder-kind publishes a 156 page prophesy with a catchy title which was lapped up by the silicon valley elite and funded to the tune of 10s of Billions. And, not sticking to his lane, the wunder-kind enters the finance world thinking his brilliance translates there too, and he was promptly taken to the woodshed by the wall street sharks.
I am using openrouter with zdr guardrail which routes to any provider that supposedly doesnt train on user data. I also use fireworks (directly, not via openrouter) which is a provider promising zdr and has a bunch of open weights models. My issue is that these zdr providers dont transparently disclose caching/tokens etc and so they end up being far more expensive than directly using DS.
I meant something I could download and run.
You could have said the same of linux - that it extinguished proprietary OSs at least for server usecases.
So, are they planning to announce an optimized coding agent harness as well ? DSv4 flash is a fantastic model, and my daily driver. With reasonix or pi, I can code all day long and pay a few pennies for it. No token anxiety. Whereas the same model with fireworks/openrouter, with zdr thrown in, token costs ratchet up with no explanation. Likely that the model is subsidized for gathering usage data. I am waiting for the day I can run this locally.
Short-termism at its peak. Code maintainers will learn the hard way how to set the boundaries between ai-generated code, and human maintainable code.
LLMs are the script kiddies of the day.
So, instead of math/programming, tax codes approximate the real world better. Whereas math/programming/images/languages are frozen in time. I find this fascinating. Almost like the legal system, wherein rules are laid out in english but are almost mathematical in the sense that there is a legal/illegal judgement made for almost every action, but that judgement is not easily determined.
At this point, openai and anthropic have no problems announcing these deals because is good narrative, and helps them raise funding and IPO.
The same thing happened in dotcom. Deals and partnerships were announced because it helped raise money. I recall energy companies (enron/dynegy) doing deals with network vendors. Eventually, the deals were not worth the ink on paper but it helped raise funding.
Excel has network effects. If N people are using excel, the incremental N+1'th user is forced to use it or risk not being able to open documents from the N users. Excel is also sticky, in the sense that a user used to Excel UI is hesitant to switch to a new UI. Tokens dont have network effects. If N people use fable, the N+1'th user could use any other model, and have no impact.
Remember mythos ? I was half-expecting them to scare us with a new danger: How AI can covert code into other languages, and confuse the hell out of all of us.
The model is fantastic. And costs almost nothing. The only problem I see is that they will train on your data.
There are zero-data-retention providers of DeepSeek models, of which I have used openrouter (with zdr guardrails), and fireworks. But these are 3x to 5x more expensive than directly using DeepSeek, possibly due to poor caching. Thats the price to pay for zdr.
What appeared initially to be a huge innovation was later easily duplicated by many. There are no platform-lockins or network effects. Switching costs for users are zero, and there are low barriers to entry, with vast numbers of models to choose from and more appearing every day. As a business a token will be a commodity like an electron. Doesnt matter who produces it, or how (solar, wind, coal, nuclear etc) as long as it powers my toaster.
When you own stock at a broker in a margin account, you may sign an agreement to allow the broker to lend out your stock to someone else. For lending your stock, you are entitled to a stock-borrow fee which usually is quite small say 0.25%, and paid by the borrower (short-seller). The borrower then sells the stock to someone else. At a later point, the short seller closes their position by buying it back, and returning it to you. This is roughly the mechanics of it. So, to answer your question, the short seller makes money from folks who buy high and sell low. In this specific example, the stock-borrow fee say was 5% because, the float is still low, and if the short seller borrowed at $165 after the IPO and sold it, and then bought it back at $135 and closed their position, they made money from folks who bought at $165 and sold at $135.
Can you point to data that suggests rate of token revenue growth is slowing ? This announcement, and the price cuts from openai are hints in the direction of pressure from open weights models but not conclusive.
By definition, creativity cannot be automated, and AI is a fantastic automation machine. It can explore thinking paths at a rate humans cannot match. But creativity is bringing the unthinkable into the thinkable, and that requires sensory experience [1]. Specifically, new definitions and symbols which never existed before. Imagine the concept vector space, and expanding that with new independent dimensions. Is that even possible ? When you look at history the answer is yes !. And each time there was an independent dimension added, it was an act of genius. It is an instructive exercise to name these moments in history where an independent dimension was added to human thought. Some examples in math would be the invention of a number, and in politics could be the idea of democracy. By contrast, LLMs are trapped in the vector space they are trained on, and they lack the feedback loop with sensory experience to be able to create and validate theories.
[1] https://philsci-archive.pitt.edu/28024/1/Scientific_Inventio...
If there is any data to support this, please share.
same, pi as a harness works best, better than claude code and open code.
Nailed it ! There are some folks who behave holier-than-thou just because they happen to use some language. Language missionaries if you will, and they are insufferable.