A handful of vocal voices can delay a project, raise its cost, and make it untenable.