I was in a similar position with my first company, but waited too long because we were such close friends. I view failing to fire him as my biggest mistake/failing as CEO of my first co.
If you want to talk, drop me a line here and we can hop on the phone. I have a strong opinion on this topic: http://mattmireles.com/contact/