I think it is correct that it breaks down the candidates confidence. This exactly happened to me, I have a computer engineering degree, was a very competent programmer as far as my courses were concerned. I ended up taking a job in Product because of how difficult some of the interviews were, I wasn't sure my programming skills were up to snuff. I have been working on personal projects in my free time to keep my skills and think I might give it another try at some point.