It's worse than that. One finger dragged up moves the cursor up, two fingers dragged up scrolls the window... down? Is it really sensible to be internally inconsistent?
It also runs counter to scroll wheels on mice, which has a physical reason for the direction too.