I liked this siggraph presentation about how some people at NVidia see the games industry adopting a more VFX-like pipeline, for a lot of the same benefits you talk about:
http://on-demand.gputechconf.com/siggraph/2018/video/sig1813...
http://on-demand.gputechconf.com/siggraph/2018/video/sig1813...