Sounds like my advanced PyTorch course (except that I didn't put as much emphasis on distributed). :)
I haven't become enchanted with moving to online yet. You ask about interactivity, and that seems to be the difficult part to me. For the exercises, I haven't found anything just like sitting in front of the same screen with my students.