Hacker News Reader

Taste or vision? They are hill climbing and they can't see the other side. And sometimes that is because they don't live in your head and don't know what you want.

View on HN

Very insightful actually. Taste and vision are both instances of holding a model that predicts a good result beyond the threshold of validity in theory but reality happens to align. Is it luck then? Perhaps meta-luck where lucky weights produce “accidentally great” results with some predictability.

Steve Jobs had a mental model that brought the iPhone. No one really wanted it but something in his life biased the result.

So creativity is having weights so good you can project way out into latent space beyond what is reasonable.

Nice to get some resonance. And if I may, past --> taste; vision --> future. And to compensate for our poor memory, taste<=>value network while vision<=>policy network, borrowing from RL parlance.

I hope you’re not actually trying to compare human cognitive processes to an LLM, because that would be incredibly reductive, not to mention lacking in any empirical grounding.

Reply on news.ycombinator.com