Lunch is my break from work. I leave the office and go somewhere, whether it's to take a walk in the park, go to the gym, or just grab a bite out and read a couple chapters.
Also, trying to get three or more people to agree on a time and place for lunch is less fun than herding cats.