Discuss HN: Will 100M token LLMs replace most programmers?

I recently had a conversation with a friend who's a Delphi developer on a large ERP project. He's been relying heavily on ChatGPT for SQL queries and specific functions, and now he's talking about fine-tuning it on their entire codebase. His claims about the future of our profession have left me unsettled, especially in light of recent developments. Magic, an AI company, just announced some significant breakthroughs:

Developed LLMs with 100M token context windows (~10M lines of code or 750 novels) Their LTM-2-mini model shows strong performance on a new, more rigorous evaluation method called HashHop Claim their algorithm is 1000x cheaper than Llama 3.1 405B's attention mechanism for 100M token context Partnered with Google Cloud to build AI supercomputers using NVIDIA's latest GPUs Raised $465M in funding, including $320M from new investors

My friend argues that with capabilities like these, AI could replace most programmers soon, leaving only a few to oversee the AI's work. He even suggested many intellectual jobs could be replaced very soon due to rapid AI progress. As someone studying to re-enter the field (Angular, JS, HTML, CSS), I find this both intriguing and concerning. What do you think? Is this a realistic assessment of where we're headed? How do you see the role of programmers evolving with these increasingly capable AI assistants? Could tools like this make programming more accessible, or will they reduce the need for human programmers?