1. Difficult to build. It's proving incredibly hard to achieve any decent range for electrical road vehicles. This multiplies manifold when trying to cram components into a much smaller space and make the whole thing fly.
2. Difficult to control. Gusts of wind, predatory birds, reliable bandwidth etc.
3. Trivially easy to defend against. Think mosquito nets, burqas and cheap radio jammers.