Exactly, we're seeing the time horizon shrink rapidly. There have already been numerous threads ruminating on the fact that even a few months of not paying attention will result in you lagging behind in this technology. I can't wait to see what happens when state space models are developed further[0]. If the prompt and output length can be increased significantly then large chunks of the work of building software could be offloaded to these tools.
[0] https://arxiv.org/abs/2212.14052