True, but the greater danger of integrating security into every department is discounting security in favor of the main requirement of your department. Your department is viewed for political and performance reasons, budgeting time away from the main goal of your area towards security is technically ... waste.
Additionally, you ignore the business logic cross-departmental issues when you do not have a centralized security department.