The whole thing made me see why the situation in SV is so screwed up: If we can't really ask for things that show real experience levels, and it's all about short term first impressions, set by interviewers that aren't even necessarily any good at interviewing, how can we improve?
I've always much preferred interviews that asked for the same amount of time, but where people could show a picture of their real output, instead of a little puzzle.
Imagine you are hiring a chef to man your restaurant, and what you ask him to do is get through Chopped: Give him secret ingredients, and ask to make a dish using all of them in 15-20 minutes. You'll be testing something: Some people will do better than others. But are the things you are testing really going to matter, in practice, when what a chef really has to do quickly is to execute a well known, practiced menu, along with kitchen management skills?
We don't test for the things we do at jobs, and therefore, we can't hire. Not a surprise.
This is the problem. It allows one interviewer with a pet peeve to torpedo an otherwise excellent hire. Where I work, whoever ends up on the wrong side of the majority needs to make a case good enough to convince the majority to switch. Being strongly in the minority is not good enough.
The culture of accepting high false negative rates leads to the "no weaknesses" hiring the GP was complaining about.
I've been able to successfully hire good people by noting that some interviewers are never satisfied with any candidate. Once the pattern is clear, I either remove them from the hiring process, or politely disregard their opinion.
Hiring only with 100% consensus is a sucker's game. Some of my best hires have involved judging which "no" could be overridden safely.