I generally lose 1 kilo a day on bikepacking trips (or 100 km every three or four days). No yo-yo effect.
As you say, doing low to moderate intensity exercise for a long time -- like walking 20km a day for a week, which is double what the Hadza walk -- is enough to cause me to lose weight unless I'm eating more to make up for it.