If an appropriately senior office of the company invites someone (equity holder or not) to observe or participate in the internal affairs of the company then it is that officer's responsibility to make the situation clear to the employees which whom he/she will be interacting and to oversee such interactions. Needless to say, if such interactions cause distress or could constitute harassment then it is the officer's job to deal with the problem.
To state the blindingly obvious, I may have shares in IBM and expertise in cloud computing but that does not entitle me to walk into IBM data centers and sit opposite ops staff all day.