Its a job that takes time, commitment and impacts your reputation. It isn't a trivial title on the side while you do real work.
So if you think that the board might be held liable by shareholders for something in the future it is usually a prudent step to create as much distance between you and the board as a shareholder as you can so you don't end up on both sides of a lawsuit.
I guess the reputation cost is a good point, but Kalanick is always going to be associated with Uber, whether he's officially on the board or not.
That said, its more like a 5-10hr / wk commitment, not a full time job.