You can watch a few conference talks where folks really go to town on Linus for his bad behavior.
On GPLv3 lots of calls for Linus to stop supporting GPLv2
"How do we get you to stop..."
https://www.youtube.com/watch?v=PaKIZ7gJlRU
And the list goes on and on. That said, his decisions seem to have worked out amazingly well. At some point I can imagine getting tired at having to repeatedly defend your views.