e.g. Dual Photography: https://graphics.stanford.edu/papers/dual_photography/
I would guess it may be blurry?
And even with "point" light sources and the parallelized light patterns, the whole scanning takes a while:
> This image is 578x680 pixels and was acquired in a little over 2 hours.
The swapped image has the same resolution as the projector, so it seems yes, you'd get a very low resolution image if you used a large light source like the sun. You can see this in the "Accidental Pinhole" supplemental video. The reconstructed image is very low resolution, but the quality is slightly better when the light comes in via a smaller area (a mostly closed window).