I'm pretty sure it's the exact opposite.
Watch old films and the nighttime scenes are... almost cartoonishly lit. Like there are hidden floodlights everywhere, or just filmed in straight-out daytime but underexposed.
Whereas modern film and TV looks far closer to reality. I don't know what you mean at all that the "state of the art is still stuck with habits and techniques". If you've been on the set of a modern film or TV production, the state of the art is, well, state of the art. The lighting would be unrecognizable to someone from 30 years ago.
Can you give an example of a scene in a new movie you consider to be badly lit because of old "habits and techniques"?
Green-screen is a totally different situation, because it didn't exist before. But even there I think you're making a mistake with comparison to Star Wars. Have you watched The Mandalorian? Because that's current state of the art, and it's stunning. The environmental lighting is real, and the technology they use to achieve it is utterly amazing.