Many irc servers listen on an ssl port, but this then only encrypts data between client and server. The data is decrypted on the server and sent to other clients. (Maybe encrypted)
Some ircd's support "encrypted only channels" where if you're not connected via ssl, you can't /join