It's mostly old school moderate liberals who call themselves classical liberals. Because today's loudest self described liberals have abandoned core principles like free speech. So the moderate among us have to make this distinction.
Calling us conservative or right wing is a way to other us, to kick us out of the tribe. It's purification. See the endless torrent of hate being directed at Bill Maher lately for maintaining liberal values. I've seen it hundreds of times on Twitter, "I'm so done with him! He's not one of us."