attentionmech

I guess reasoning and healthy self-doubt to be built in system. Already the reasoning thing seems like 2025's candidate for what large labs will be zeroing down on.

My first through after seeing this post was that it's a real world eval. We are running out of evals lately (arc-agi test, then sudden jump on frontier math, etc). So it's good to have such real world tests which show how far we are.

thanks!

Reminds me of recent paper where they found LLMs are scheming to meet certain goals; And that is a scientific paper done by a big lab. Are you referring from that context?

Words and their historical contexts aside, systems which are based on optimization can take actions which can appear like intermediate lying to us. When deepmind used to play those atari games - the agents started cheating but that was just optimisation wasn't it? similarly when a language based agent does a optimisation, what we might perceive it as is scheming/lying.

I will start believing that LLM is self aware when a research paper from a top lab like Deepmind/Anthropic put such a paper in a peer reviewed journal. Otherwise, it's just matrix multiplication to me so far.

Related to this but little theoretical question - If you add an intelligent predictor of market which wins over other consistently by X% - then the market will start using that information and wouldn't that make our intelligent predictor lose it's edge?

More simply what i mean to ask is -> the moment market knows about your advantage, shouldn't you lose it because everyone else will use that information to balance the market?

This made me chuckle. You made a very interesting point that if LLMs are copying hallucinations those hallucinations are not infact hallucinations.

source code: https://www.github.com/attentionmech/tildnn/blob/main/projec...

may be for some sub-domains like math and code it can do that since the verification process can be done / relatively tractable

you just defined two levels. It wouldn't be so hard to define intelligence IMO. honestly lot of smart people already are working on all this and it's just they publish it when it's relevant or it comes to light when it's needed.

I legit see that if there is not even a new breakthrough just one week, people start shouting plateau plateau.. Our rate of progress is extraordinary and any downplay of it seems like stupid

Isn't this at the level now where it can sort of self improve. My guess is that they will just use it to improve the model and the cost they are showing per evaluation will go down drastically.

So, next step in reasoning is open world reasoning now?

This can be a good tool to teach kids programming/generative-ai

Intelligence is ability to achieve goals. If X can achieve a goal X and Y can't - I would say X is more intelligent. As long as the goal G is open world goal both X and Y are tested for sufficiently long time.

That's what lately I am thinking in terms of what is intelligence.

My use of word "appear" was deliberate. Whether humans say those words, or whether an LLM says those words - they will look the same; So distinguishing whether the underlying source was a idea or just a language autoregression would keep getting harder and harder.

I don't think I would put it in the way that LLM has no "ideas"; I would say it doesn't have generate ideas exactly as the same process as we do.

I think rather than a single test, now we need to measure Turing-Intelligence-Levels.. level I human, level II superhuman, ... etc.

all conversations appear like mimicry no matter you are made up of carbon or silicon

I think firstly you should try to make meetups virtual and based on topics of interest? let the system get traction and then do physical things. Also allow users to have their own username so that they can choose to disassociate with their original HN account for privacy.

I would personally join a virtual online meetup on my favourite topic for sure! If not that, I would watch it later on youtube FOR SURE. It's like a discord for hackernews tbh.

I don't know why i got downvoted. "It lends credence to the notion that quantum computation occurs in many parallel universes, in line with the idea that we live in a multiverse, a prediction first made by David Deutsch." -- this is from the article itself.

What does it mean when they say that the computations are happening in multiverse? I didn't know we are that advanced already :)