No, you actually do have a lot of leeway in how much you eat, where you body stays the same weight, because the body adjusts how much energy it uses. Also "excess calories gets you fat" might be a circular argument or truism or whatever, as in excess calories is excess only because it gets you fat.