Londoner here - I personally don't press the button if it's only me and the road is not busy since the time I would save would be lost over all the people I would make stop just for me.

I've seen many people not press the buttons thinking it's just there as a placebo, it's mostly tourists though as it's common knowledge amongst Londoners that the button signals the traffic operating system that a pedestrian would like to cross.