a great part of the fear is that you can not see radioactivity harming you. Water I can see. Mining coal feels like it is within my control whether I engage in that activity or not.
I don't have a good answer for re-assuring these folks. (carrying a counter with them seems to be a non-starter, but perhaps a cell phone app would be ok)