Depends alot on the codec too. Light weight codecs like Tico/jpeg-xs and some jpeg implementations can use very little ram (~12 rows worth). Others need alot more for rate control, motion estimation, etc.