Even if morality was just herd instinct, what you were saying previously is that suffering for you is not immoral. And even though, many intelligent people saw absolutely nothing wrong with torture, what about you, right now?
What I'm getting at is that your original statement which basically said "suffering is OK" (you didn't indicate any restrictions or conditions) is just bullshit.