If you put the panels in a diagonal (NW - SE), and you rotate each panel on its vertical axis, the need for space would be limited to a series of circles the diameter of the panel width.
Plenty of people have gardens and land that is tended to multiple times through the day anyway (for gardening, animals, workshop activity etc).
Now your panels start shading one another.