Every control/alignment system has overhead. That is exactly why distributes systems are both hard and slow, just look and Spanner/Cockroach and compare them so single node PSQL.

To get rid of managers, you will need to solve comms problem.