I'm always unsure. These days, I'm generally a pretty positive guy but I know I've struggled in the past.
On this particular team I was definitely not the biggest asshole. In fact, after this manager left, the biggest asshole was fired pretty much based on the fact that the new managers weren't willing to tolerate his attitude. The bro culture of the team was curtailed (which is why I was so much happier on it afterwards).
It's very hard to be a manager, a people leader. I don't think he was wrong to bring up the fact - he was doing it because he wanted to protect his company - but it certainly danced around a line of legality. After I withdrew my application he made sure to tell friends of mine that he had rejected me because of my depression. Really mature, that guy is.