We have two boys who are tri-lingual (thai, german, english). The essential thing is that the kid makes the association:
one person = one language
If you speak both English and Chinese to your son, he might be later confused on what words are from which language.
I would recommend you only speak Chinese to him. For our kids, English is now their strongest language but it was only taught by their 'environment' i.e. kindergarten / school and they started with English only at age 2-3. Now they talk English with each other (before they went through a period in which they talked German or Thai with each other). So you should not underestimate the 'environment language'.
Also, you might consider having some other relatives speaking certain specific languages with your son (e.g. grandparents). This could reinforce their language skills.
Personally, I do not believe that learning languages from TV is effective. Learning languages is about relationships and interaction. I think the 1 hr per day would be better spend on interacting with your son in the respective language, e.g. by playing memory game etc.
Regarding late development of speaking. We did not experience this with our kids. But they might be a bit delayed when learning to read and write because of different phonetic rules of the respective languages.