For instance, at HuggingFace:
> A few days after that, Thom Wolf, who was my manager at Hugging Face and also one of the co-founders, messages me, “Hey, can you get on a call with me ASAP?” He told me that they had fired people from the research team and that the rest would either be doing pre-training or post-training — which means that you are either building a foundation model or you’re taking a foundation model and making it an instruction-following model, similar to ChatGPT.
[1]: https://www.quantamagazine.org/when-chatgpt-broke-an-entire-... [2]: https://old.reddit.com/r/MachineLearning/comments/11rizyb/d_...
I do wonder how people are adjusting to similar, ongoing shocks across other industries. For instance, the ArtStation protest against AI art a couple years ago showed widespread hostility towards the technology. In the time since, AI art has only gotten better and been adopted more, but from articles like [1] it doesn't seem like concept artists have much benefitted.
[1]: https://aftermath.site/ai-video-game-development-art-vibe-co...
I guess everyone on Hacker News should stop developing software then, since almost every piece of software I've ever worked on has allowed companies (and individuals) to do more with less.
It's an intractable problem because even if some really astute senior engineer joins a company and notices the unnecessary complexity and knows how to fix it, there is no way they will do anything about it. Do you think thousands of existing engineers will support a plan to refactor and simplify the complexity? The same complexity which guarantees their job security? It's so easy to discredit the 'new dev' who is advocating for change. Existing devs will destroy the new dev with complicated-but-deeply-flawed arguments which management will not fully comprehend. At the end of the day, management will do what the majority of existing devs tell them. Devs will nod in unison for the argument which sounds more complex and benefits them the most.
Nobody ever listens to the new hire, even the new hire knows they are powerless to change the existing structure. The best they can do is add more complexity to integrate themselves into the scheme.
Ironically, the new hire can provide more value doing nothing but that will not provide them with job security. The winning strategy is to trade-off deep long-term value for superficial short-term value by implementing lots of small features loaded with technical debt.
It's like gears in a big machine, you could always add 3 gears to do the exact same job as 1 gear but once those 3 gears are in place, remove any of them, the machine stops working... So each one seems demonstrably essential to anyone who doesn't understand the tech. That's the principle. When pressed, a merchant of complexity can always remove a gear and say "Look, the machine doesn't work without it, just like I told you."
I sympathize with this position, but I think it’s worth admitting that it’s also often the case that the complexity increases all made sense at the time of implementation, and the big rewrite in the sky is often more expensive, more risky, and likely to still end up with new complexity than is anticipated at the beginning.