I like the concept. It's sort of like watching TV with a bunch of friends. Interactive voting on the next video is very cool.
But, here's your biggest challenge: This concept doesn't work without a bunch of users showing up at the same time.
Tomorrow, when this is off the front page of HN, how do you plan to get people to come back? If you can solve that, you've got something.