Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by VMG | Hacker News Reader

Parent Full thread

VMG·

just because it's a non-human artifact doesn't necessarily mean it's boring

for instance, people like Minecraft-generated worlds even though no human has crafted them

View on HN

I never played much Minecraft but I assume that's some procedural generation where a human crafted the procedure.

(Am I being downvoted for not playing enough Minecraft? I apologise.)

sure, but humans have also crafted LLMs

Yes, but then again, completely no. I mean, a procedural generation algorithm for a game world is an artwork tuned to produce results the artist likes, usually with care to allow some cases and exclude others and meet a particular vision. It's not very different from a pre-made world, except using the RNG as one of its building blocks.

Same can be said for prompts. What's the difference from a pleasing underground mine cave labyrinth and some weird Pulp novel plot?

True, so I went and looked for the prompts:

https://github.com/EQ-bench/creative-writing-bench/blob/main...

Not clear on how these elaborate prompts relate to the very short prompts in the samples.

Different benchmark, those are for the short form creative writing leaderboard here: https://eqbench.com/creative_writing.html

>tuned to produce results the artist likes

Kinda like RLHF?

Well, LLMs aren't just randomly spitting out garbled text either. Humans create and curate the training data, humans design the models, and humans train them.

Reply on news.ycombinator.com