No one is denying that the climate is changing. It always have and it always will.
The discussion is about how much, how big a problem it is, how much of it is because of us and to what extent we can/should do anything about it.
That's the actual debate. Calling someone a climate change denier is a cheap and sloppy shot at trying to lump a much more complex discussion into a simple pro/con.