Returning to fraud detection, high order interaction features like "billing address = shipping address and transaction amount < $50" are required for good model performance.
I agree, that non-linear models are often able to beat linear ones, but if you have limited amounts of data feature engineering will always beat clever algorithms.