> The downside is that your downward speed also increases

You're saying the down component of the velocity vector also increases with the velocity itself. Not that heavier objects fall faster, which we know to be untrue from Galileo's famous experiment. I think you understand that, but I thought I'd clarify it.