Who cares if they're doing exercise or not? The person who takes walks presumably knows it's a form of exercise. They're not talking about the other forms, they may not be able to do Crossfit or go skiing, and they might not feel confident expressing opinions about the entirety of all exercise, but they definitely know that walking works for them.