Don't get suckered into using a bot. They may be cheaper in the short run but you know you're going to get lifebanned. My prices are nothing compared to your future earnings.
Don't get suckered into using a bot. They may be cheaper in the short run but you know you're going to get lifebanned. My prices are nothing compared to your future earnings.
It also depends on the type of problem. If you just need one weird trick to pass the level (e.x. use this SQL injection) then that's easy to game. If you have to write a bunch of distributed systems code (e.x. Stripe's last CTF) that's a lot harder to cheat.
For now, I'm assuming they have good protection against automated solutions. If it were just a matter of detecting plagiarism, you're right that it would be trivial. (Heck, I even cofounded a company that did code plagiarism detection, so I have a very good sense for how easy or hard it is. tl;dr: it's straightforward to defeat a plagiarism detector if you are sufficiently motivated and knowledgeable and willing to put in some time to go through all the code, but people/companies who plagiarize are typically none of those.)
Detecting whether someone else is doing the candidate's work, on the other hand, is impossible. Unless you bend the rules. Fortunately, the rules seem pretty pliable to me -- when a candidate arrives at a company's interview, spot-check them on their understanding of a few of "their" trickier solutions. It's a logistical nuisance, to be sure.
The verification burden shouldn't be on the hiring company, it should be Kalzumeus...
I don't think they'll really need to worry about these things for quite a while, though. Good problems to have, I guess.
The open source portfolio really is kind of a golden standard. It is real work that you have done, that has (hopefully) advanced the commons, because you love programming and have something unique to add to the world. Some fake video game programming may indicate something, but is simply not as strong an indicator.
Who are you going to hire- TJ Holowaychuk, who wrote Express, or the guy who placed 3rd on TopCoder in 2012?
Honestly, after mind-taxing eight hour job, you want to go home, watch a movie, read a book or some other relaxing activity. Not to mention that for people with families, it is nearly impossible to find the time to contribute. The rockstar-ninjas with thousand-starred repos on Github are very rare.
Then this person probably wouldn't find much time to do CTF challenges, either.
♯And let's be fair, 99% of what's "open source" is junk anyway, just because you wrote an 80% done static blog generator doesn't mean you're "advancing the commons"
I don't agree. Only a small segment of the talented programming folks I know do open source contributions.
The scam you've described may be possible, but it's not very rational for someone to use it, IMHO.
Though that's where my scam would be most likely to fall apart. Recruiters typically only get their cut if the candidate doesn't get fired in the first N months. So if they purely cheated their way in, then the hiring company is only out a couple months of useless work. (Which could be very costly, to be sure, but at least they don't have to fork over the $50K. And there are many other reasons why a new employee doesn't pan out.)
I suspect that too, and this is something I'd really want to read more about - how does self-policing work in black markets and how effective is it. If anyone has any good sources, I'd be grateful for sharing.
RE fraud prevention, there were two interesting lines in the Starfighter's announcement:
> We assess for skill first, passively as players play our games and then actively. Our founders — talented technologists — personally reconstruct candidates’ solutions and evaluate them.
> We follow-up with players to ask if they have any interest in a no-obligation chat about career options. If they’re interested, we have an honest geek-to-geek conversation.
I suspect that between the first and the second there will be a place for Starfighter team to verify that the candidate has the skills his account shows. After all, if they want to maintain the access "deep into the hiring funnel", they have a strong incentive not to send bad candidates and waste their clients' time.