Many people want to be without the company of strangers in their commute => a self-driving car will, on average, not carry more passengers than cars do now.
Most people want/have to arrive at work in a relatively short timeframe (7-9 or thereabouts)
Combining that with a 30 minute commute, the average autonomous car will be able to drive 2-3 people to and from work each day. It also will have to drive 1.5-2.5 times the distance per passenger (into town, back to pick up the second passenger, into town again for two passengers, another round trip for the third)
I think that will be a net win, but it will be less than that 95% idle figure hints at.
That net win will decrease traffic jams tremendously, though. It is anybody's guess what that will mean. On the one hand, ride times could go down, and automated cars could be able to make another round trip during peak hours.
On the other hand, people could move farther out into the suburbs, offsetting that. That is a serious possibility, as you could start working/shaving/brushing your teeth/reading/playing on your Xbox during your commute. If that happens, chances are that those who can afford it will want to own their own self-driving car, so that they can stock it with things they may want to use during their commute.
I think the latter is a serious possibility. Because of that, I am not sure we will see a decrease in the number of cars.