m3ch4m4n

lol why is this on the front page of hacker news?

why is this on the front page of hacker news? lol..

Yeh, "Computer science curricula must evolve from syntax memorization..." starting with this right out of the gate makes me either deeply worried or sincerely skeptical about the following thoughts of the author.

My experience is that people fresh from getting their computer science degrees had the opposite problem where they didn't have enough practical courses coding something real to set them up for success in the real world.

I have been testing o1 all day (not rigorously). And just took a look at this article. What I observed from my interactions is that it would misuse information that I provided in the initial prompt.

I asked it to create a user story and a set of tasks to implement some feature. It then created a set of stories where one was to create a story and set of tasks for the very feature I was asking it to plan.

And while reading the article, it mentioned how NOT to provide irrelevant information to the task at hand via RAG. It appears that the trajectory of these thoughts are extremely sensitive to the initial conditions (prompt + context). One would imagine that if it had the ability to backtrack after reflecting, it would help with divergence, however, it appears that wasn't the case here.

Maybe there is another factor here. Maybe there is some confusion when asking it to plan something and the "hidden reasoning" tokens themselves involve planning/reasoning semantics? Maybe some sort of interaction occurred that caused it to fumble? who knows. Interesting stuff though.