Hacker News Reader

It's a math word problem, in which LLM's would not perform well. I have no idea why people try stuff like this.

People try stuff like this because it's precisely the kind of problem that AI would be useful for. If one of these models turned out to be really good at it, it would signify that they're now useful for a whole class of problems.

Besides, GPT-4 did solve this question perfectly. I like that rather than just involving math, there’s also some real life knowledge needed to give a practical answer.

If you want to solve math problems, LLMs are very useful for this. Exactly how trained professionals are.

You make the model write code for you to solve it.

Would you ask your dad to compute the correlation matrix between 40 thousand vectors? No? Then don't ask an LLM to do it.

I ask ChatGPT / Bard to do all kinds of things I wouldn't ask my Dad for. This is a weird perspective.

Because it exposes accuracy problems as querys often involve implied or implicit math skills.

Reply on news.ycombinator.com