In the interview he's talking specifically about saying "Yes" or "No" to an acting job.

If he says "Yes" to everything he'd be in a lot of terrible films. This could be a detriment to his career.

I think it's a completely different situation when you're talking about whether or not you hang out with a friend. In that case, I'd agree with you.