I think weight loss is more than just calories in/out. Maybe our body reacts to adapt to situations and tried to change the body shape to make it easier for itself. So I think healthy habits are more important and can depend on genetic history too.
I also imagine the emotions impact digestion and storage of fats and a lot more, basically adapting our bodies to our perceived environments, so it kinda baffles me that we don't study the emotional impact more.
Being under stress might make you burn lots of calories, but stress ends up being weight gain in the long term because the body tells you to save up more energy for next time.