In some communities, otherwise offensive phrases have been desensitizes or misappropriated. Those communities might have projects which are only used by them, but are public on github.
Somewhat similarly, most of the repos on github are single-contributor "private" projects that just happen to be public. I see nothing wrong with them expressing whatever they want in their code and comments... but I do think it's out of line for a third party to come out of the blue and cast a ruling on it.
I can see the argument that "Oh, it's just a pull request, they don't have to accept it", but I still don't like this project as a whole.
I don't think the repos with offensive words or hate speech are driving people off of open source or github or coding, only off of those specific projects - as they deserve.