Assuming that it’s technically practical, the results would be very unsettling: the phone screen would look like a window with the content “behind “ the window, very far away.
I doubt that effect would be very strong as the effect of a magic eye massively dominates any feeling we have to notice that our eyes aren't having to do as much of whatever you'd call this lensing work.
…But geometric aberrations might be annoying: The image is perfect in the center but blurry/rainbowed 10° from the center, etc.