Yes, because you can also debit money from IBAN :) Without consent of owner. Not sure how this works.
The money you get that way isn't guaranteed, the account owner could do a charge back. And if that happens you have to show the signed authorisation from the account owner. If you don't have it, expect your bank to terminate the direct debit ability.