Hacker News Reader

Comment by whycome | Hacker News Reader

I've intentionally been running it now just to see how wrong its summaries of messages are. So often, it relays the exact opposite of the intent and I want to understand why.

View on HN

Interesting.

My impressions are the exact opposite: it perfectly summarizes everything to the point like 98% of the time at least.

> My impressions are the exact opposite: it perfectly summarizes everything to the point like 98% of the time at least.

Yep, that's my experience as well. I take screenshots (and report them) when I see a wonky one, which has happened twice.

It has to be 100% accurate. No Trumpisms allowed.

Maybe I'm just a billy no-mates, but even with perfect accuracy the kind and volume of notifications I get on my phone just wouldn't really benefit from summarisation. Maybe for a group chat I haven't checked in a while, but outside that it's not like I've got people sending me essay-length messages.

Well, I'd say it's probably 'right' like 95% of the time where it conveys a good sense of the original intent/sentiment. But, that other 5% is what is "way too often" because in those instances it can be so far off that it could be classified as "not even wrong"....

Seems like with the last update (the italicized summary notifications) it's gotten every so slightly better. But yes until now my friends and I left it on just to enjoy how absurdly wrong the summaries were.

I'm doing the same. It's mostly correct on my end, though sometimes it fails in humourous ways. I have a friend who does gig work as a food delivery driver, and delivered to someone who was consuming cannabis and mentioned both in a message. It summarized as delivering cannabis to someone.

Reply on news.ycombinator.com