I would not punish them for having a mental illness, I am understanding of it as I have, too, but it is completely fine if you, yourself, do not want to handle or deal with it.

I tend to call people out, too. I keep the ones that take it gracefully.

Quality > quantity. :)