The truth is - you'll miss some great candidates because they simply interview poorly and of the flip side sometimes get a professional interviewee that cannot deliver once hired.
You can also get a brilliant 10x candidate but a complete asshole (e.g CEO wanna be) that will destroy your team once hired.
We don't know how to accurately gauge a candidates experience, personality or knowledge. We can only make them perform monkey-see-monkey-do on a whiteboard or through stupid, asinine puzzles and leetcode style exercises.
To make matters worse, we often place our most senior software developers on interview circuits. For better or for worse, engineers trend towards more anti-social traits. It makes the whole process of understanding one's personality, how they think, and whether or not they'll be a fit for the company a complete crap-chute. This is literally the only industry I have been apart of that sucks this bad at a process that is so fundamental to professional life.
I would rather interview at McDonalds or for a call center (having had both of those jobs).
It's a chute you shovel crap into (or out of), with no justifiable expectation of useful results. The interview process as a whole is a crapshoot, but the process of understanding the candidate is a crap chute.
We have proven time and time again that certain times of interview questions are not helpful.
If you look at the best investors, their job is similar, I would say that most notably as YC being crazy successful and found similarly in my own hiring is that passion for a given space is one of the best predictors of success.
The pool of candidates interested in full-time jobs is not the same as the pool of candidates interested in doing contract-to-hire positions.
Contract-to-hire selects for people with the ability to risk working for a company for a period of time without a high risk of near-term unemployment if it doesn't work out. The people willing to take those jobs are usually more qualified to begin with because they have more career options open to them if the contract-to-hire doesn't turn into a contract job.
So you're basically pre-selecting your candidates.
Sounds interesting. If you happen to have links to any articles about that, it'd be interesting to read
Turns out I still had it open, half read, in one of my 100+ browser tabs :-)
Nice to hear that you recommend it. (Hmm I wonder if maybe some of the other things you've read were also based on Schmidt & Hunter, 1998?)
I have in mind to do as they recommend (incl work sample tests and structured interviews and work knowledge tests), when/if later on I'll look for people to help me with the software I'm creating.
I wonder b.t.w. if you know about any automatically generated GMA tests?
(Edit: I found some, I can post a link if you want.)
It'd be nice if there were ways to auto generate GMA tests. Then maybe it could be just fine if everyone was allowed to practice as how as they wanted -- if there was an unlimited supply of new questions, because they were auto generated.
Maybe something with generating random 3D shapes and applying rotations.
But then it seems to me it's necessary to measure how well begin good at such things, correlates with being able to learn and get good at software, and scrap any poorly correlated tests.