Whenever money is involved, invert Hanlon's razor. High prior on malice, low prior on ineptutide.
Some well-meaning team of data scientists might have produced this model originally. But its employment in this manner cannot be assumed to be anything other than malfeasance, except in the face of significant evidence to the contrary.