Good idea. Added to the playbook for RHEL only.

On Debian normal unloading of the module works.