It's been several years since I read Malcolm X's autobiography, but he did specifically talk about his relationship with Ali and what happened, which was the real basis of my comment. Malcolm's depiction of the events is much more negative from my recollection. I just provided the above link instead, since I wasn't able to find an excerpt from the book.
Not sure why my previous comment was voted down, given that it was both true and on topic. I can only assume someone would prefer to keep their hero on a pedestal rather than admit everyone has their flaws.