It depends on the type of video processing and whether you can handle adding latency.
I think that people grossly underestimate the amount of processing that can be done on video. Reasonably sized filters, something like deinterlacing, high quality transforms. Swamping a modern CPU in terms of memory access or processing isn't too hard.