It's a super valid point. We are not claiming all decisions should be taken this way. But we can imagine a system where a large chunk of decisions can be devolved to the citizens. The constitution and the bill or rights provide a framework in the same way congress today can't legislate (or shouldn't I would say) agains our rights.