I feel like this introduces the potential for weird and hard-to-implement side channel attacks, if the sequences in a batch can affect the routing of others.
the language models in our heads have not caught up to the ones in our browsers.
as the similarities and associations crystallize a bit better, it won’t look so hard.
bookmark this if you think it bullshit. eight months.
monkeys.