We’ve come full circle to “BERT has a mouth and it must speak” https://arxiv.org/abs/1902.04094