> Photons are responding to the curvature in space-time, not directly to the gravitational field

In general relativity, space-time curvature is the gravitational field, so I'm not quite sure what distinction you're trying to draw?