If anyone is interested in this an wants to learn more, start with natural image matting - that is the more fundamental research topic of which colorization is one use.

While I'm sure this is interesting to many people, the results here are extremely poor compared to modern techniques.