Why is it so Hard to Swat a Fly?

Not so much with a fly swatter (https://en.wikipedia.org/wiki/Fly-killing_device#Flyswatter).

I'd say the tick speed is relevant, but much more important is avoiding air draughts that propel the flies out of the way.

They're not. It just takes practice.