IMO calling someone your direct report carries with it the connotation that you also have non-direct reports. Maybe I’ve been misinterpreting but I’ve been hearing it as a subtle way someone can bring up how high they are on the org chart.