Did you test any of this, or is that just your gut speaking?
Some people have funny ideas about how DD works, not realizing it's extremely consumer friendly and much smaller fees than credit cards.
I was thinking of offering both as my brief play with GoCardless was very easy to implement.