omalled

When my family moved to a house with a dedicated playroom, my wife and I were dreaming of getting the kid’s toys out of the living room. A friend told us “Either they play where you live or you live where they play.” I’ve found that to be true. Do you find a yolo sandbox like this has a similar tradeoff? Like, you don’t have to approve permissions in yolo but you’re constantly copying stuff to and from the sandbox. In the end maybe your stuff ends up “living” in the sandbox.

I agree that they're not hitting a plateau and I see it in my reserach. I had a math/code benchmark paper [1] at NeurIPS last year that is still unsaturated. At the time of writing the paper, the best model was o3, which was scoring 3-4%. By the time NeurIPS came around, GPT-5.2 was the latest model but it was getting similar scores to o3. The models were still in the flat part of the usual hockey stick curve. The newer models are getting into the steep part. I evaluated gpt-5.6-sol+codex a week or two ago and it got ~16%. Astra+codex got ~24%.

On some tasks in this benchmark, the models seem to be coming up with novel solutions. For example, Astra came up with a relatively simple formula for a sequence that only has 8 terms in OEIS and is considered "hard" [2]. It produced a lean proof that the formula is correct, but I'm just starting to learn lean and don't have enough expertise to check it.

[1] https://proceedings.neurips.cc/paper_files/paper/2025/hash/c... [2] https://oeis.org/A000530

You might want to check out this very nice article on reservoir sampling, which discusses its application to logging: https://samwho.dev/reservoir-sampling/

I also wonder how much the memory feature plays a role. I gave it a picture of the street I live on that isn’t online anywhere. O3 guessed the town correctly. Then, I turned off the memory feature and did the same thing. It didn’t even get the state right.

Do you have a link or something that goes into how to do this?

Can you say in one or two sentences what you mean by “lazy at coding” in this context?

Can you say more about what “using GPT-4 is optional” means? What features do I lose by not using GPT-4? How do I opt out?