Btw, I'm not saying it's just the number of parameters that matters.
57 karma · joined June 13, 2017
Btw, I'm not saying it's just the number of parameters that matters.
The fundamental difference lies in how patterns are formed in each case. For LLMs, all they know are the patterns they observe in "words" - that is the only "sense" they possess. But for humans, pattern recognition involves continuously ingesting and identifying patterns across our five primary senses—not just separately, but simultaneously.
For example, when an LLM describes something as "ball-shaped," it cannot feel the shape of a ball because it lacks another sense to associate with the word "ball-shaped." In contrast, humans have the sense of touch, allowing them to associate the word or sound pattern "ball" with the physical sensation of holding a ball.
This is why even most software projects (built by humans) go through multiple iterations before they work perfectly.
We should consider a few things before asking, "Can AI code like humans?":
- How did AI learn to code? What structured curriculum was used?
- Did AI receive mentoring from an experienced senior who has solved real-life issues that the AI hasn't encountered yet?
- Did the AI learn through hands-on coding or just by reading Stack Overflow?
If we want to model AI as being on par with (or even superior to) human intelligence, don’t we at least need to consider how humans learn these complex skills?
Right now, it's akin to giving a human thousands of coding books to "read" and "understand," but offering no opportunity to test their programs on a computer. That’s essentially what's happening!
Without doing that, I don't think we'll ever be able to determine whether the limitation of current AI is due to its "low intelligence" or because it hasn’t been given a proper opportunity to learn.
Or should it be like a brain that comes with preloaded knowledge? (like how it is today)
I think that is what is driving the current VC funding trend in dev tools. Also, considering the future of software engineering, dev tools will have even more adoption than before.
And regarding the pessimistic comments in HN, they are mostly coming from people who lack in-depth knowledge about how businesses work.
From day one, keep these in mind
1. Anyone can build anything, given they have the time and money, and resources. But only a few people can understand what their customers really want, and build that.
2. You are not an engineer. You are an entrepreneur.
3. You are not here for a solo game. Can you be a great leader?
4. You should understand how your decisions affect the company's finances.