He said "term limits" not "remove all power from elected officials." We already have what you call a "permanent bureaucracy" - it's called the civil service. It executes orders from elected officials - the President, cabinet officers, and every civil servant's paycheck is dependent on the good will of Congress.

Limiting the influence of lobbyist's campaign contributions will empower ordinary citizens since elected officials will be more dependent on pleasing us to get elected rather than pleasing large donors so they can use large donor money to run media campaigns to get elected. Reducing the influence of large campaign donors will not give the civil service any more power than it has now.