But the pilot requires more design compromises. The requirement to have a large canopy protruding from the fuselage for maximum visibility is a challenge to both building a stealthy aircraft and aerodynamics.
Also, currently the pilot and their circulatory system keeps aircraft from turning at more than ~9G (and then only for brief periods of time). Without a pilot, it would be possible to build aircraft with stunning maneuverability.