If walking takes a toll on your body you should consider adding strength exercises (push-ups until they become easy, then bench press, bodyweight squats until they become easy then weighted squats, deadlifts etc.).

I also experienced hip pain and knee pain from walking and I no longer have any pain (after getting stronger) even when walking 30km per day during my active vacations.