I'm curious why you'd actually want to go through the pain of using a programming language to do this. I think there's a reason why this isn't popular -- video editing is insanely hard if you want something non trivial, and basically doing this in a programming language is sort of doing Assembly compared to doing C#.