Full threadandes314·Linear time attention doesn’t work, by principle. Dead end pursuit. Much great research on more efficient quadratic time inferenceView on HN