The context window has been shattered: Subquadratic debuts 12M-token window

Discussion yesterday: https://news.ycombinator.com/item?id=48023079