I have no doubt he could learn them. He's a smart guy. But the idea that he could drop into any job at Microsoft and excel on Day One is silly.
No, but they should at least know how to do the job of their SVPs or VPs in their absence. In fact, many times when the SVP departs, their reports are expected to report to the CEO directly.
But even appointing someone new for that role will require the CEO to understand that role very well. They truly can't appoint someone competent in that role without being competent themselves.
I don’t think the original comment was saying that it is crucial for somebody to fill in for their reports (that might be true, but it is a different aspect). Rather, they were saying that the manager’s skill set must include the skill-set of the person being managed, in order to evaluate the latter.
I think there’s some truth to this, but there’s also obviously got to be some attenuation factor going on, otherwise we get this “visit every node” problem.
The suggestion of firing every manager that can’t run the test suite seems like it ignores this attenuation factor. It might be a set of command line scripts with funky in-house flags. But they should be able to draw some some of useful conclusions from the output IMO.