Could you speak more to the "deprojection" step? What is that?
So it works by trying to estimate a 3D 'room' that matches your image. Everything from the geometry, to the light fixtures, to the windows. It's heavily inspired by how humans (weird to contrast 'human' vs. AI work) do image/video compositing.
TL;DR: Image in, 3D scene out.