RWKV-8 ROSA – An attention-free neurosymbolic LLM

"enabling LLMs to invent their own inner monologue languages"

They will become an even deeper black box?