That doesn't matter if the panorama is stitched using the same projection as the lens (i.e. rectilinear panorama for a rectilinear lens, or a fisheye pano for a fisheye lens), because projection and field of view are the same, so the images are the same.

Note that professionally made panoramas are often made with more complicated and hand-tuned projections like Panini.