Financial companies deal with far more complex risks than this every day. Making a fraud-heavy account profitable is as simple as demanding a surcharge.
Maybe some of the smaller guys don't have the resources to manage an account with the extra complexity. But EVERY company giving up a juicy profit opportunity? No way. The answer they're giving is the correct one: they simply aren't allowed to process payments from adult websites.