> we don't have any good idea how this tech works.
Do you mean the specifics of GPT-4, or Transformers in general ?
Do you mean the specifics of GPT-4, or Transformers in general ?
a few months ago, just this year some researchers discovered what might be the neuron that largely decides when to use an in gpt-2. yes 2. that's what he means.