No one is saying that at all. Pointers aren't evil, but they are dangerous.
Perhaps a better analogy is a sharp chef's knife. In the right hands it's an effective and efficient tool that lets you do things quicker and just as safely as any other tool.
In the wrong hands it is dangerous to the person using it and to those around them.
There are numerous other examples: welding torches, motorbikes, explosives etc etc.