You don't just need the cameras to see each other, you need them to be perfectly parallel to each other as well, as otherwise they're photographing along a different plane, which may give conflicting results.
More concretely, if the cameras are photographing along different but parallel planes, then they won’t see each other.
More concretely, you can have two cameras photographing along different but parallel planes that do see each other.