Hacker News Reader

I'm kind of surprised GPT-3 doesn't "understand" haiku. You'd think it could extrapolate the rules?

The logs are broken!, Sysadmin sweeps up the leaves, The database cried

The encoding used by GPT-2 and GPT-3 greatly obscures many of the textual properties of words. This at least partly accounts for why it has so much trouble with meter, rhyme, syllables, and some math.

More info: https://www.gwern.net/GPT-3#bpes

Thanks for putting that info here!

Hahaha, thanks for trying it out!

It's honestly mind-boggling that we now have tools that even make something like this possible.

(Even though GPT-3 clearly has to read more poetry.)

So it didn't figure out the syllable counts and it mistakenly thought the haiku should rhyme. But it's amazing that we have come to a state where the critiques are so minor.