For those interested, it appears as though David Baker (who dedicated his life to protein folding) has also turned to deep learning. His lab recently published https://www.biorxiv.org/content/10.1101/846279v1, which seems to outperform Alphafold with a very concise architecture. Code and model is at https://github.com/gjoni/trRosetta