Software Raises Bar for Hiring
webcache.googleusercontent.com
webcache.googleusercontent.com
I have $100 here that says most won't (if any).
* If we can't hire people due to a broken system, how do we expect to succeed?
Also, once you've done a little training the sunk costs fallacy can kick in, even if you wouldn't hire them in hindsight.
I know it so well that the last person I recommended (for the recruitment bounty) breezed through after I tipped her off on the coding questions. I could get through the whole process easily. I doubt I'm the only person.
What kind of people set questions in interviews without knowing what answer they're hoping for? How do they know if the candidate is any good if they don't know the answer themselves? That sounds.... well, it sounds insane.
The kind of people who want to "see how you think."
I probably botched an interview where they expected me to come up with an RB tree fast enough (it was a company that has posted on HN).
Tipping people off to questions is cheating the test, so you have some people trying to temporarily bulk memorize algorithms that they'll forget in another month before an interview. Does anyone else not find this stupid?
The irony is that software engineers are so much rarer than everyone else in the market we can easily be hand screened thus bypassing the very software we created. Finding software engineers is really hard because there are so few so either you don't get a lot of people applying, which makes it easy to screen by hand, or you set the bar very low to get people in the door. Then you go through 6 months to find the right person.
If you aren't a software person its much much harder to find a job because there are so many other people looking for jobs. You have to compete much harder, downward wage pressure, etc. Hence the volume increasingly demands automated solutions that make it even harder to get past the screeners.
I happen to agree with this article that we do a poor job of specifying the skills that are absolutely mandatory vs. what's nice to have. If we back off on rigid skill set we can find great people than can grow into a job.
I don't get your beef.
The phone interviews are there to screen the 80% of the applicants who don't merit the time of my team to interview them. The puzzles are there to watch people think on their feet. The detailed questions are to see if you're looking at someone superficial or someone with deep knowledge of the subject matter. The programming challenges are to see if the applicant wants the job badly enough to spend a couple of hours working on a programming problem that can then be used as a showcase for how they write some software.
Earlier in my career, I didn't have all those interview techniques in place. When I started, hiring people was a complete crap shoot and I ended up with some total lemons. Like the warning labels on products you buy, each interview technique I added to the process was the result of a lame hire that in hindsight, I could have avoided had I used that technique.
The last job I had to interview for used all the techniques above. I found the interview process to be thorough and challenging. I appreciated the rigor of the interview process since it meant that the people hiring really gave a shit about the quality of the people joining their small team. I got the job. In point of fact, if they hadn't had a thorough interview process, I probably would have passed on the job offer since that would have been an indication to me that they were naive and didn't have their crap together.
Do you want to send me your $100 via Paypal?
Sadly, I don't use Paypal. You can make a donation to your local hackerspace with the $100 that you will soon lose.
Good luck.
PS. Have you ever asked the people you have interviewed what they think about the process?
Almost without exception, people who don't get hired never hear back from a company as to why. Yes, I know all about "everyone's afraid to get sued for saying something wrong". So... develop a neutral feedback form to candidates as to why they were passed over, skills the interviewer(s) thought were lacking, etc. This will mean that people can get better, perhaps get another job (yes, maybe at a competitor, but also maybe somewhere else entirely), and continue to earn income, pay taxes, and contribute to society in a productive way. Some people can contribute without a job, sure, but right now most people need jobs.
Telling someone "we're sorry - we had 8 candidates apply for this position, and we ended up taking on someone with more experience in X, Y and Z compared to your experience level. We wish you the best of luck in your job search". This would be courteous, professional and helpful all at the same time. Between my own experience and that of several colleagues, fewer than 5% of employers ever provide something even remotely useful in terms of feedback.
How do we expect the job seeking population to get better without providing feedback mechanisms for them to learn from?
And what about the cases where your reasons are not "more experience in X, Y, Z"? Cultural fit is a biggie - one might turn down a candidate who is more qualified because his banking attitudes would go over badly at a startup, for example.
Companies don't seem to realize that treating applicants bad is just as detrimental in many cases as poor customer service. I've had bad experiences with job application processes, and I've told many people chapter and verse about the companies involved. If they can't even treat people well who want to work there, how will they treat customers after the money is received?
If unskilled candidate X gets "other candidates had more specific skillz" while uncultured candidate Y gets "sorry, you suck for unspecified reasons", it sounds like a lawsuit risk.
Specifically asked? I've received lots of feedback from people who made it through the process. They've added to my bag of interview techniques here and there. In general, they appreciated a hiring manager who spent a lot of time and effort fielding good people. Those kinds of comments tend to be a bit self-selecting, though.
I've had a couple of candidates who didn't make it get frustrated with the process. One in particular lost his cool just trying to pseudocode a routine to determine prime factors of the input or something like that. If you lose your composure doing something like that, I don't want you in the trenches with me late at night when we have a demo to show to customers the next day and something isn't working.
When people have asked me for feedback on why they weren't made an offer, I've always tried to be as candid as possible; especially when it seemed that they were sincerely trying to improve. Screw HR and their obsessive need to CYA.
Genuinely curious: why do you consider spontaneity an essential trait in a programmer?
Maybe the CEO got a not so gentle nudge from the investors to hurry up and hire somebody and you were the one they were interviewing next. Stuff like that happens a lot. The process is more about outside factors than the actual interviewing process itself.
But when these conversations turn into arguments it all comes down to some applicants being more "qualified."
There are lots of reasons people get hired to do jobs they've never done before and lot of those reasons are subjective.
I'll take your bet, if you are still inclined to give away money.
On the non-technical side, the basic requirements are exactly that - basic. Have some experience, a certification or two, and a specialized degree. That doesn't make it easy, but it makes the path somewhat concrete.
And on the technical side, there are very few companies willing to hire entry level developers. They all seem to want code ninjas, which is fine, but here's the thing...if I'm a code ninja, why would I work for someone else when I could build something of my own without the requirement of commuting to an office and clocking in/out.
On the employer side, I've found far less people applying for technical jobs than non-technical jobs. It has taken much longer to fill mid-level technical positions than entry-mid level non-technical positions.
Building a team is difficult. Joining a team is difficult.
It's a very strange time indeed.
It's easier to bullshit when interviewing for non-technical jobs. Technical jobs have mostly-objective tests you can give to candidates where they have to program stuff, solve equations, etc. Non-technical jobs have squishy mostly-subjective tests that aren't very reliable at gauging anything.
This would be extra beneficial for young people, who really just need to get a foot in the door to prove themselves -- they need someone to take a risk. Well, maybe we should reduce the risk.
See "Covenant of good faith and fair dealing" (which in some states mean you have to be fired for 'just cause') and "Implied contract exceptions".
I say these not to indicate you're wrong, mostly to make sure the entrepreneurs around here understand that even in a lot of "At-Will" states they might not be able fire completely with impunity.
w/r/t the GP as long as the rules around a trial period are set via an employee handbook or in the contract, generally in the US we're fairly free to try people out and let them go, the US is actually more liberal in this then a lot of European countries.
I don't quite know how we as a culture do it, but we need to wean ourselves off of 'employer-provided benefits'. Getting back to a more consumer-driven market vs large employer group-driven market will make our job/work situations easier for generations to come.
If employers are so picky that they can't find anyone to hire, then they will have to lower their standards if they want to hire anyone.
There might be a delay--like the guy that waits for the supermodel to come along, but eventually settling for the pretty girl next door. Ultimately the problem is self-correcting.
I am still convinced the problem is on the employee side...
The underlying problem is that there is a lot of unemployment and therefore too many people applying for too few jobs.
We just don't need that many people to order around anymore now that we have so much hardware and software automation. The public education system is designed to create wage slaves, and is effectively doing that, but we don't need that many anymore.
Another part of it of course is just that we are in an 'economic' down period and therefore have to be extremely selective when hiring since no one can afford any dead weight or even to do much training.
The entire 'economic' model has been invalidated by technology.
The other half of the problem is that our economy creates very few sources of income for the supposed "creative class", the newest Class of the New. If we say that our economy has evolved beyond the need for factory workers and we now need artists, writers, and hackers, we need to actually work on creating jobs for artists, writers and hackers (as distinct from mediocre programmers).
I just think that the extreme hierarchies and subservience are unnecessary and detrimental. I think we need to examine our basic assumptions and have a realistic perspective about the actual level of suffering that is currently going on in the world.
We need to see the extreme inequality as being unacceptable and move away from the Social Darwinian rationalizations.
I don't want to do that. I think that almost all anti-capitalists are missing a very important lesson that we can take as a major success of capitalism: diversity and distribution is very important for robustness and ease of system evolution. Technocrats, techno-communists, social democrats, almost all seem to be aiming for centralization which has been proven to be extremely inadequate.
So I think the way forward is to create a system that while encouraging a great diversity of distributed, localized solutions to problems, at the same time the local solutions are developed and evaluated holistically over a comprehensive common global scientific information schema and database.
This is the problem right here. Gee I wonder why you couldn't find a job in "Classics"? Because there aren't any, at least with an undergraduate degree. People pay you to work because you can perform a given task with a level of quality and consistency. We tell kids that they should study whatever makes them happy in college, but then when they graduate and can't find a job it's not their fault. Fine you study your BS degree, but don't expect to be handed a job when you graduate. Expect to work some menial job, or do what this kid did, go back to school and learn a trade. You'll have to prove to someone that you have some employable skill if you want to earn money. Having a job isn't a right.
http://mavweb.mnsu.edu/howard/Schmidt%20and%20Hunter%201998%...
sums up, current to 1998, much of the HUGE peer-reviewed professional literature on the industrial and organizational psychology devoted to business hiring practices. There are many kinds of hiring screens, such as resume reviews for job experience, telephone interviews, in-person interviews, checks for academic credentials, and so on. Most of the most commonly used means for screening job applicants, such as those mentioned in the submitted (like matching job titles in previous positions) are basically useless. There is much published study research on how job applicants perform after they are hired in a wide variety of occupations.
The overall summary of the industrial psychology research in reliable secondary sources is that two kinds of job screening procedures work reasonably well (but only about at the 0.5 level, standing alone). One is a general cognitive ability test (an IQ-like test, such as the Wonderlic personnel screening test). Another is a work-sample test, where the applicant does an actual task or group of tasks like what the applicant will do on the job if hired. Each of these kinds of tests has about the same validity in screening applicants for jobs, with the general cognitive ability test better predicting success for applicants who will be trained into a new job. Neither is perfect (both miss some good performers on the job, and select some bad performers on the job), but both are better than anything else that has been tested in rigorous research, across a wide variety of occupations. So if you are hiring for your company, it's a good idea to think about how to build a work-sample test into all of your hiring processes.
For legal reasons in the United States (the same consideration does not apply in other countries), it is difficult to give job applicants a straight-up IQ test (as was commonplace in my parents' generation) as a routine part of a hiring process. The Griggs v. Duke Power, 401 U.S. 424 (1971) case in the United States Supreme Court
http://scholar.google.com/scholar_case?case=8655598674229196...
held that cognitive ability tests used in hiring that could have a "disparate impact" on applicants of some protected classes must "bear a demonstrable relationship to successful performance of the jobs for which it was used." In other words, a company that wants to use a test like the Wonderlic, or like the SAT, or like the current WAIS or Stanford-Binet IQ tests, in a hiring process had best conduct a specific validation study of the test related to performance on the job in question. Some companies do the validation study, and use IQ-like tests in hiring. Other companies use IQ-like tests in hiring and hope that no one sues (which is not what I would advise any company). Note that a brain-teaser-type test used in a hiring process might be illegal if it can be shown to have disparate impact on some job applicants and is not supported by a validation study demonstrating that the test is related to successful performance on the job. Companies outside the United States are regulated by different laws. So don't set up stupid HR procedures like those described in the submitted article, even if those stupid procedures can be automated. Instead, figure out how to give applicants a work sample test, or figure out how to validate a general cognitive ability test for the applicants you desire to hire. Automating USEFUL processes can be helpful. There is no reason to automate a process that is not worth doing.
I would love it if companies hired people like colleges select students.
I'm very good at interviews, but I still hate doing them. If would love it if I could write an essay and send them my SAT scores without going through that awful process.
It would probably also weed out people who are just inordinately good at interviews.
I don't overtly try to exaggerate, but a few times I've been offered a job where I thought in the back of the mind that I might not really be qualified. To wit, I thought my interview skills, not my coding skills got me the offer.
Also, all the SAT does is see how well you can take a 4-hour test.
Of the combinations of predictors examined, two stand out as being both practical to use for most hiring and as having high composite validity: the combination of a GMA test and an integrity test (composite validity of .65); and the combination of a G M A test and a structured interview .(com posite validity of .63).
We just finished interviews last week and a few people who looked perfect on paper were not even considered after the interviews.
I was one of two interviewers and I only threw softballs.
It's interesting how we still run to the government to solve our own past mistakes.
"Note that a brain-teaser-type test used in a hiring process (might be illegal if [both] it can be shown to have disparate impact on some job applicants and [if it] is not supported by a validation study demonstrating that the test is related to successful performance on the job)",
not "Note that a brain-teaser-type test used in a hiring process (might be illegal if it can be shown to have disparate impact on some job applicants) and ([furthermore] is not supported by a validation study demonstrating that the test is related to successful performance on the job.)"
As I read the sentence, a general brain-teaser is supported (by all the research showing that tests of general mental ability are predictive), but it is not legal unless you've done a study specifically for that brain-teaser.
So if you hire a smaller fraction of any racial category of applicants than there were in the pool of applicants or in the workforce of your region, then your hiring method has disparate impact. If you use an objective test that contributes to that disparate impact, you have to be able to prove by thorough studies that it was the best method to pick staff for the specific job you are hiring for. Such studies start around seven figures and won't work for positions with multiple responsibilities or difficult to measure outputs.
Is it necessarily because of the hiring method, though? Couldn't it be possible that there is something about the company as a whole that causes people in a protected class to avoid applying to the company? (For example, if the company has racist ads.)
This gap may diminish if you're looking at a pool of people who passed some previous threshold, eg they have a degree in math. But even then, some of the gap remains, due to the shape of normal distributions. Think of the heights of men and women, and how even if you looked only at people six feet and taller, the proportion of women in that pool who just barely meet the threshold of 6' would be much higher than the similar group of men; despite the cutoff, the average height of the women would still be less than the average height of the men, within that group. Draw overlapping bell curves to see this visually, and analyze the areas under the graph of each distribution, to the right of a given cutoff point.
We do have a law against invidious racial discrimination. The current implementation of the law states that in practice, if some selection mechanism has a passing rate for one minority that is less than 80% of that whites, that is evidence of discrimination in the absence of validation of that mechanism. This is known as the four fifths rule. A test in which 10% of whites and 7% of blacks passed would fall afoul of this law. Say you set a 115 IQ threshold. That is +1 S.D. from the white mean roughly, and +2 S.D. from the black mean, meaning 16% of whites and 2.3% of blacks would pass, if drawing from the general population. That wouldn't even pass a 'One fifth rule,' let alone a four fifths one.
And validation is no sure thing either - police and fire departments have had these tests validated and still have the results thrown out regularly, due to disparate racial impact, i.e. relatively few blacks and Hispanics (average IQ: ~90) passing the test.
On a related note, explicit racial and gender quotas are more efficient than the race- sex- and IQ-blind, approach in use today. A quota would mandate in effect different thresholds for different groups, but it would allow one at least to use this selection mechanism. Within given groups, one would obtain more efficient outcomes. The problem with quotas is that they make racial preferences explicit, while abandoning such selection methods entirely is only an implicit, de facto racial preference, a rather subtle and hidden one at that.
Like the article stated, it's due to lack of experience in the job they are applying for, coupled with the skills gap. Employees are asking for more experience than applicants have.
Intelligence is not a factor if they are only looking for experience.
http://www.apa.org/pubs/journals/releases/amp-67-2-130.pdf
and investigating how the gap arose in the first place has been very illuminating about the effect of early childhood environment and formal schooling on the development of IQ. But, yes, the reason the Supreme Court ruled as it did in the 1971 Duke Power case is that there has been a difference in the distribution of IQ scores among "white" and "black" people in the United States, and also an odious legacy of efforts to deny employment opportunity to black people, so if a company has a particular hiring process, it had better make sure that the hiring process will "bear a demonstrable relationship to successful performance of the jobs for which it was used."
See the writings of James R. Flynn, particularly
http://www.apa.org/pubs/journals/releases/rev1082346.pdf
http://www.iapsych.com/iqmr/fe/LinkedDocuments/dickens2006a....
http://www.iapsych.com/iqmr/fe/LinkedDocuments/dickens2006b....
http://www.iapsych.com/iqmr/fe/LinkedDocuments/flynn2007c.pd...
and
http://www.iapsych.com/iqmr/fe/LinkedDocuments/flynn2010a.pd...
for background on the narrowing gap between "race" groups in the United States.
It's weird, as the actual policy was "requiring a high school education or passing of a standardized general intelligence test".
Surely there's a lot of African Americans with a high IQ, but no degree. Wouldn't this case mean that requiring a certain level of education is worse than requiring a high IQ?
Be it a customer service rep, or a software engineer, when the employer says "Do X" if you don't know how to do it, figure it out. So many people will just sit there and stare into their screen or at a wall. That is the type of person these tests are designed to weed out.
As others pointed out, if you are not willing to put in the effort and jump through the hoops, why bother, either you feel your too good for the job and won't apply yourself, or you lack the basic understanding of problem solving and troubleshooting.
If critical thinking was the skill being sought, rote memorization seems like it shouldn't have any emphasis at all. You can always look up data structures, or whatever, but that is often not good enough.
What I fear, however, is that this isn't really a problem for the executives for a public company. Their real compensation these days is all tied to stock prices; I don't see the incentive to really care about HR. How does adding people change the stock price? (Usually I only hear about it from the other way; cutting jobs to cut costs.)
Have you ever heard of investor pressure to hire candidates?
Are there startups already looking at this problem? If not, why not? And, who's up for a challenge?
In general, people aren't qualified to do their jobs. That doesn't mean they shouldn't be doing them, or be hired to do them. It means the qualification system is broken.
The problem is the software and the software is not going to go away. The opportunity is to make the software more intelligent so that the output is more in line with what would work.
Not to mention the cost you could get for the unemployed to sign up ("It costs you on average 2k/month not to use our service").
I do think that this problem is up there with world peace.
I mentioned it in another comment already, but this problem is what I'm tackling with They Meet You (http://theymeetyou.com). At a minimum, I'll be using it where I work, but check it out if you want.
How it works is really simple: You can send a message to anyone that proves they work for a company, if you interest them then they can share their contact information with you.
The biggest problem I see in hiring people is that good resumes get filtered out by HR departments because the resumes don't have the precise keywords. Fix that by hiring smarter HR people.
This is pretty much why I started building They Meet You (theymeetyou.com) during my spare time. The way the site works right now is pretty simple. You can write a message that is meant for anyone at a company (@customink.com), anyone that proves they have an email address there can read it and exchange their contact info.
I hope to be able to spread a wide net to find the best... not a fine net to find a unicorn.