That's pretty cool. I feel like these people (who very smart people choose to lead), must be some next level incredible intellect.
Depending on what you do, you might have a natural gift or be a good learner for management skills—but you also may not. If you're not and shoehorned into it for tenure (or whatever other reason), both you and your students suffer.