That’s the topic of my thesis ! Here’s some work by open ai doing exactly that ! :) https://arxiv.org/abs/2202.01344