I've been wondering lately, it seems like audio books might be an amazing training resource for models like these, if you could get the script that the reader was working from!
It's 1000 hours of audio book readings, segmented by sentence, with transcripts. All from project Gutenberg, so maybe a little bit heavy on Victorian bodice rippers and such, but certainly a great trove of training data...