You'd have a pretty hard time making the case that the OP was making his co-workers feel unsafe unless you had some concrete proof of a threat of violence or something along that lines.

Not wanting to work with a depressed person is not a valid termination reason because of the categorization as a disability.