This is exactly what we do on https://www.soundslice.com/features/ (the minivideos below the main hero section). Would definitely recommend using MP4s instead of GIFs, for the bandwidth savings.
Apparently these gifs are loaded along with the other assets and lazy loading them is not simple.
We moved to mp4 and the scores have increased quite a bit.