Again, this is not different to local democratic processes.

Voters typically cannot directly stop somebody being named leader of their party or given a specific role within government for multiple terms. If you dislike them, you pressure your elected representative to change that.

Almost all representative democracy is accountability through a representative, not directly through control of government internals & positions.