Next time that happens ask him/her to bring you a coffee, works most of the time...and you can have e little "secret" chuckle.
A good project manager will be confident in their position and in doing whatever they can to help the project and won't mind. But that type of person wouldn't be looking over your shoulder unless invited.