This is where I feel like the title "project manager" ought to be reconsidered, perhaps to "project secretary." That way, it's a bit more clear there's less of a hierarchy and more of a duty.
It's a mentality. You just need to hire people who are both smart and able to do the job, and can also see that all people are equals.