Only in his unscripted communications. His reputation as a speaker stems from his delivery of messages that are usually pre-written. He's got plenty of dramatic pauses where normal people would say "ummm".
He's considered a good speaker when he is rehearsed. He is considered an umm-er when he is speaking candidly by anybody who doesn't also speak like that.
In his defense, everything he says is hyper-analyzed so he does have to be more careful than most of us.
I, uhh, think you make aaaaaa, a good point there.