I'm pretty sure we are eating more calories than our grandparents did, too. Portion sizes for common things are much larger now. You can look at muffin sizes for example and how the average muffin is physically larger today. Same with burgers, soft-drink cup sizes, etc.

But yeah I agree with everything you said as well regarding lack of physical exercise.