The photo improvements are a result of taking multiple pictures and processing them into one image which you can't do with video.
Also, if your image bit depth is high enough, you can create "virtual" multiple exposures from a single image and do exposure fusion. Google already do this with HDR+ on stills.
The bit depth stored from the sensor could be a lot higher than the current 8bits most mobile phones use for video, if you have full control of the ISP. Cinema cameras can process and store 12-16bit video (Red, Blackmagic, Arri).
Even Apple does this to some degree with their "extended dynamic range" video on newer iPhones, though the saved files are still 8bit.