How would you compensate for candidates that are great developers but are new to Rails, or whatever specific language/framework your company uses?
How would you compensate for candidates that are great developers but are new to Rails, or whatever specific language/framework your company uses?
1) If you think that the language/framework is intimately important to the hiring process (I don't but I'm not judging) then you don't compensate for that. It's an important data point.
2) If you don't think its important, you don't worry about matching "idiomatic" practices. You don't judge on obvious library mismatches, etc. If you don't feel confident doing that. Don't have the challenge interact with any language specific code. Let them do it in any language you feel confident of judging.
The less flippant answer is, you give them a deadline but it is both A) flexible in the face of their "real life" (ie if they tell you they are going on vacation next week deal with it) and B) it deals with realistic time horizons (ie a week, not 4 hours).