I ran a debian-based distro on a Lenovo thinkpad in graduate school from 2008 to about 2011. I had basically the same experience. Everything worked 95% of the time, but that other 5% felt entirely random and pretty dehabilitating.
Now I use a mix of Win, OS X, and Ubuntu depending on what I am trying to accomplish. I make heavy use of Linux servers, but have no inclination of using one as a primary end-user desktop environment again.