Would You Hire a Calculator?
june.kim
june.kim
My understanding is that these questions are a proxy for intelligence, and they were asked because Google and the like want smart employees.
If that's why you're asking these questions, than testing using agents in the interview process doesn't make sense, because:
1. If you're hiring smart people, you can probably teach them how to use agents. (training someone to use agents isn't very hard)
2. If someone is smarter, you might in general expect them to be more capable of finding bugs in AI code.
> proxy for intelligence
you're right, but it's too easy to gamify, or cheat on.
> can probably teach them how to use agents
I've met smart people that were anti-agentic coding. It's not a direct translation.
> finding bugs in AI code
I think this would be a better proxy for job performance than DS&A.
And if you're using an LLM to do your job for you in an interview, then you extremely probably are not smart enough to notice its constant, inevitable mistakes.
Same argument goes for letting LLM to do my job for me at the job. Plenty of smart people use LLMs to help code at work, and they fix the mistakes. Using an LLM doesn't mean accept its output without verifying that it works.