One thing I haven't seen mentioned in previous discussions of this and NeRF: how does the scene lighting effect new dynamic objects that are added to a scene?

For example, suppose this technique is used to render the static parts of a level in a video game (possibly even with some baked animation). What will happen when you put all the game characters, particles, bullets, and other moving things in?

Will we need a separate light layer for these? Or can the dynamic lighting be inferred?