"To our surprise" is an adverbial. It has no voice. It can modify passive or active constructions, but it does not prefer one over the other.

Active: To our surprise, they had left the door open.

Passive: To our surprise, the door had been left open.