HNHacker News
TopNewBestAskShowJobs

hausrat

13 karma · joined April 4, 2025

submissionscomments
hausrat··on Less human AI agents, please
This has very little to do with someone making the LLM too human but rather a core limitation of the transformer architecture itself. Fundamentally, the model has no notion of what is normal and what is exceptional, its only window into reality is its training data and your added prompt. From the perspective of the model your prompt and its token vector is super small compared to the semantic vectors it has generated over the course of training on billions of data points. How should it decide whether your prompt is actually interesting novel exploration of an unknown concept or just complete bogus? It can't and that is why it will fall back on output that is most likely (and therefore most likely average) with respect to its training data.
hausrat··on Mathematicians hunting prime numbers discover infinite new pattern
The very notion of discreteness depends on subjective definitions of "objects". We take concepts of objects for granted because they make interacting with the world tractable, but it's really hard to define them outside of minds.