The majority of times I see things like this it turns out that it's either:
- The "they've built it wrong" case; this one is the most common. People using - or in this case being made to use at work - tools that behind the scenes all use very cheap models (e.g. 4o-mini) with little context, half vibe-coded up, to save costs. The company making "MagicSchool" doesn't care, they want to maximize those profit margins and they're selling to school administration, not teachers, who only look at the costs and don't ever actually use the products themselves. Just like classic enterprise software in traditional companies. They need to tick boxes, show features that only show the happy path/case. It is perfectly possible to make it high quality, in a way that adds value, doesn't make shit up, and is properly validated. But especially in this niche, sales trumps everything. The hope is that at some point, this will change. We've seen the same play out with enterprise software to an extent; new such software does tend to be more usable on average than it used to be. It has taken a long time to get there though.
- The "you're holding it wrong" meme; users themselves directly using tools like Microsoft Copilot, 4o and friends (very outdated, free tiers, miles behind Claude/Gemini 2.5 pro/o3/etc.), along with having zero idea about what LLMs can and can't do, and obviously even less of an idea about inherent biases and prompting to prevent those. This combined with a complete lack of caring, along with a lack of competency - people lacking the basic critical thinking skills necessary to spot issues - is a deadly combo.
Of the problems with tasks and outcomes named in that thread, the large majority can indeed be done already with LLMs in a manner that both saves time and provides better quality than the level of those teachers rightly being criticized there. Teachers who are not even checking the output obviously don't give a single damn anyway, and that tells you enough about what the quality of their teaching would've been like pre-LLMs.