AI Forecasting: One Year In
bounded-regret.ghost.io
bounded-regret.ghost.io
Large Language Models like GPT-3 definitely aren't sentient (or even coherent often), but it's definitely more than what I could figure out how to code with vanilla python, which could not be said of the much simpler chat bot type systems 10 years ago.
Interesting and exciting things happen anytime a new tool is built and added to the toolkit.
One thing to note that this blog post skips over is that the questions placed ceilings on the standard deviation of submitted predictions, which means that individual forecasts were constrained to be artificially narrow. Therefore, don't read as much into the distributions as the means.
> Hypermind’s interface has some limitations that prevent outputting arbitrary probability distributions. In particular, in some cases there is an artificial limit on the possible standard deviations, which could lead credible intervals to be too narrow.
We're going to build some pretty incredible things.