There are two options to activate Siri: use the Home button, or just put it to your ear, as if you were talking on your phone rather than to. The second option can be disabled, but it's there and enabled by default.
I'm just too shy to walk down the street and talk to my phone without it looking like I'm talking to someone.