The fallacy here is that a human body is a machine with well-defined intake and output.
How would one even know what is "exactly" the right amount?
Over a year we consume 1 million calories. If one were just 0.1% off of systematically eating more (or less) than required then according to your model one would end up being 200 pounds fatter or 200 pounds leaner ... do you think that anyone can regulate up to 0.1% accuracy to what they actually need?
eating a little more or less has absolutely not discernible effect the body adapts to it.