True enough. Memory is also often a major constraint.
I think that people grossly underestimate the amount of processing that can be done on video. Reasonably sized filters, something like deinterlacing, high quality transforms. Swamping a modern CPU in terms of memory access or processing isn't too hard.