21 karma · joined June 12, 2019
Some roles are not being eliminated. They are never being created.
That distinction matters because layoffs recover cyclically, which may not be the case with non-backfilled roles.
I only caught it because I looked at actual score numbers after like 2 weeks of thinking everything was fine. Scores were completely flat the whole time. Fix was dumb and obvious — just don't let the evaluator see anything the coach wrote. Only raw scores. Immediately started flagging stuff that wasn't working. Kinda wild that the default behavior for LLMs is to just validate whatever context they're given.
I've been using claude code daily for months and the worst thing that happened wasnt a wipe(yet). It needed to save an svg file so it created a /public/blog/ folder. Which meant Apache started serving that real directory instead of routing /blog. My blog just 404'd and I spent like an hour debugging before I figured it out. Nothing got deleted and it's not a permission problem, the agent just put a file in a place that made sense to it.
jai would help with the rm -rf cases for sure but this kind of thing is harder to catch because its not a permissions problem, the agent just doesn't know what a web server is.
I've been building the same AI product for months - a coaching loop that persists across sessions. Every few weeks someone ships a "competitor" in a weekend. Feature list looks similar. The difference is everything that breaks when a real user comes back for session 3 or 4. Context drifts, scores stop calibrating, plans don't adapt. None of that shows up in a demo. You only find it after sitting in the same codebase for weeks, running real sessions, getting confused by your own data. That's the friction the post is talking about and I don't think you can skip it.
I wouldn't go as far as "no place in medicine" though. The Heidi scribe tool mentioned in the article is a good example, because in the end it's the doctor who reviews and signs off.
IMO the problem is AI doing the work with no human verification step, but I can 100% agree I don't want to have vibe-doctor for my next surgery/consult :D
One thing from practical experience - the quality gap between model sizes shows up in a way benchmarks don't capture. I have a system where a smaller model generates plans and a larger model can override them. On any single output they look comparable. The difference shows up 3-4 steps later — small model makes a decision that sounds reasonable but compounds into a bad plan. Perplexity won't catch that, KL divergence won't either. They both measure one prediction at a time.
That memo is how you make staff hide things instead of asking for help.
The scarier part though is that LLM-written clinical notes probably look fine. That's the whole problem. I built a system where one AI was scoring another AI's work, and it kept giving high marks because the output read well. I had to make the scorer blind to the original coaching text before it started catching real issues. Now imagine that "reads well, isn't right" failure mode in clinical documentation.
Nobody's re-reading the phrasing until a patient outcome goes wrong.
The best procrastination device ever built because it validates you the entire time. Great post, even beyond the algorithms example.
Here is DB schema(content hash is to save money on requests with the same answer):
| # | column_name | data_type | |----|--------------|-------------------------------------------------------------| | 1 | id | bigint(20) unsigned | | 2 | job_id | char(36) | | 3 | ip_address | varchar(45) | | 4 | user_id | bigint(20) unsigned | | 5 | email | varchar(255) | | 6 | question | text | | 7 | answer | text | | 8 | content_hash | varchar(64) | | 9 | status | enum('pending','processing','complete','failed') | | 10 | result | longtext | | 11 | scores_count | int(10) unsigned | | 12 | created_at | timestamp | | 13 | updated_at | timestamp |
The tool scores your answer on Structure, Completeness, Clarity, and Conciseness (0-10 each), then gives you one specific fix. No signup required.
Built with Laravel + Vue + Claude Sonnet 4.6. The scoring rubric is visible on the page + OG image.
Looking for feedback on the scoring calibration especially. Does it feel accurate to your experience?
It's a concept at the moment. But still, what do you think about such a tool if it's real?
Should I invest more time building such stuff?