> recording people without their consent is illegal in private space
Not if it's visible from the public space.
OP should check the local laws first. It's possible he had no recourse, depending on how high the drone flies. It's not like airplanes need your permission to fly over your property.