We already have people editing videos anyway, you never see the first cut. AI-matically removing umms is really just speeding up that process.
The ethical challenge in my opinion, is that your status as living human narrator on a video is now irrelevant, when you're replaced by voice cloning. Perhaps we'll see a new book by "George Orwell" soon. We don't need the real man, his clone will do.