The "loss of confidence" part, I don't see why that shouldn't be taken into account. If a candidate can't recover from failing, they're not likely going to do the same when they fail in their job. It also may indicate that the candidate is not teachable if they can't understand or have a hard time with your hint. Hints are a good way to progress an interview.