I have been working, slowly, toward a way to do something like this, for years. My latest attempt (http://alanbernstein.net/galleries/2020-pecos/) is not professional or polished, but it does work. IIRC it is canvas rather than SVG, and the "animation" is driven by the photo slideshow.

Tangentially, I find that the bulk of the work is in compiling and prepping the assets, including multiple camera devices, incorrect timestamps, buggy rotation exif data, captions from multiple sources, GPS tracks from multiple sources...

Thanks for asking here, I'm looking forward to finding a better way to do it.