The debit card number is a layer of abstraction that allows you to HIDE your bank account number from retailers. If you give someone your bank account number they can do whatever they want until you shut down that BANK account.
Someone steals your debit card or the number it's super simple to get that changed and replaced. Someone steals your bank account number it's a nightmare.