It differs by banks and countries, but e.g. my Dutch debit card only has an IBAN number on it, so anything set up to accept credit card numbers won't accept it.
Almost every online web shop here will accept debit cards, but it's through a Dutch specific payment mechanism (iDEAL).