You can probably have the game output custom-made data to serve as an input for the subsequent NN and skip a whole bunch of lighting calculations.