Correct, the line is not fitted to n=27 data points. It simply connects the highest params size between 2023 and 2026. To clarify, I wouldn't expect traditional research groups to pre-train anything >3B params WM, because this can't be done on a single GPU anymore. Just wanted to ship this as quickly as possible. Happy to do a follow-up with an actual log-scale linear regression, though.