Because this concept stems from a time when people still performed physical work and had to eat at least 3 full meals spread over the day to stay healthy (enough).

Reading the comments here makes me realise how firmly embedded the "time not spent working is time wasted" attitude is.