[flagged]
> What a load of crap
Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something.
Please don't fulminate. Please don't sneer
Please don't use uppercase for emphasis.
That’s par for the course. These things burn GPU time even when they are used as a glorified version of Google prone to inventing stuff. They are wasteful in the vast majority of cases.
> I wish I could just short Anthropic.
What makes you think the others are significantly different? If all they have is a LLM screwdriver, they’re going to spend a lot of effort turning every problem into a screw, it’s not surprising. A LLM cannot reason, just generate text depending on the context. It’s logical to use the context to tell it what to do.
ChatGPT's prompt is on the order of 1k, if the leaks turn out to be real. Even that one seems a bit high for my taste, but they're the experts, not me.
>It’s logical to use the context to tell it what to do.
You probably don't know much about this, but no worries I can explain. You can train a model to "become" anything you want, if your default prompt starts to be measured in kilobytes, it might as well be better to re-train (obv. not re-train the same one, but v2.1 or whatever, train it with this in mind) and/or fine tune, because your model behaves quite different from what you want it to do.
I don't know the exact threshold, there might not even be one as training and LLM takes some sort of artisan skills, but if you need 24k just to boot the thing you're clearly doing something wrong, aside from the waste of resources.
Also I don't think much of this prompt is used in the API, and a bunch of it is enabling specific UI features like Artifacts. So if they re-use the same model for the API (I'm guessing they do but I don't know) then I guess they're limited in terms of fine tuning.
Long prompts are very useful for getting good performance and establishing a baseline for behaviour, which the model can then continue.
Furthermore, you can see this as exploiting an aspect of these models that make them uniquely flexible: in context learning.
Re. Prompt Length. Somewhere in the comments people talk about caching. Effectively it is zero cost.