40 karma · joined April 4, 2023
2) Correctness. Subtle mistakes the AI might have missed, did you get it to handle edge cases? Did it break something else in the background?
3) Quality. This one is still a little handwavy, but there are a number of heuristics that you can use. These don't work across the board but you can design problems in a way that some solutions are clearly cleaner than others.
I would also encourage you to look at: https://github.com/anthropics/original_performance_takehome
It's a good example of the types of challenges we're working on.
my company site is infoproc dot co. it is currently down. but if you google it you can see it has been indexed. And you can search for my company on linkedin if you want to know who I am.
https://community.fly.io/t/account-flagged-apps-gone/14570
https://web.archive.org/web/20240710225525/https://community...