More on building similar web apps here [1] and on getting a computer to play director here [2]

1 - https://www.bbc.co.uk/rd/blog/2017-07-compositing-mixing-vid... 2 - https://www.bbc.co.uk/rd/projects/ai-production