Hacker News Reader

From what I've seen, the 40B model leaves a lot to be desired outside of academic benchmarks - it got almost zero answers correctly in the PyLLMs benchmark.

View on HN

Was it trained on code? On my quick glance at the training data it seemed to be a clean-up version of common crawl.

I got it to make a tiny FORTH model in python. It failed pretty hard when trying to make a Lisp, though.

Reply on news.ycombinator.com