As someone who uses both iPads and vim a lot, I'd disagree with this.

The iPad screen should be ideal for making selections with your fingers directly because the keyboard and the code are so close together.

It currently doesn't feel ideal, I agree, because text boxes are designed to prevent you shooting yourself in the foot when you touch the screen by accident. A power-user tool could remove a lot of the safety and slowness from making selections.