This is pretty much what boosting is. Although we can ask the same question of the boosting algorithm, I guess.