You need multiple cameras seeing every image point so your CV algorithms can have a good depth reconstruction -- and so it doesn't break if one camera has a lens flare. >2 viewpoints also helps with reconstruction ambiguities, etc.
Google Jump uses ~16 cameras for the same reason.