I think this is vastly over-estimating Tay's capabilities. Nearly all of the examples I saw of offensive behaviors were just generic responses to leading questions.

Everything that didn't fall in that bucket was clearly just regurgitated quotes from things it had been sent, which clearly needed moderation. But, that's no different than moderating a message board or comment section.