> [...] There are two ways to look at this issue. Some researchers think that the kind of intelligence found in biological agents is cut from a fundamentally different cloth than the kind of statistical pattern-matching large models excel at. For these skeptics, scaling up existing approaches is but a fool’s errand [...]
> Others would argue that large pre-trained models are already making strides toward acquiring proto-intelligent abilities. [...] One could see these capacities as very preliminary ingredients of intelligence [...] and there are compelling reasons to doubt that simply training larger models on more data, without further innovation, will ever be enough to replicate human-like intelligence.
> Regardless of how we answer these questions, we need to tread carefully when deploying large pre-trained models in the real world; not because they threaten to become sentient or superintelligent overnight, but because they emulate us, warts and all.