There’s literally no difference in difficulty between audio and video.
They all suffer from the same problems of indexing content. They all have multiple different encoding formats available. And they all need a frontend widget in your client for playback.
I’ve worked with both the audio and video streaming platforms and what you’re describing is grossly inaccurate. The fact that your container format isn’t including video frames doesn’t magically solve any of these issues.
Plus ID3 can be a source of new problems by itself given the way it was implemented…twice.