Small comment: It's possible to stitch together UI/video/3D without dealing with the compositor, if you use child windows instead (or in wayland terms, a subsurface). On win32 at least, it's a much simpler approach.
And of course a Wayland subsurface is using the compositor.
[1]: https://docs.microsoft.com/en-us/windows/win32/directcomp/ba... [2]: https://developer.apple.com/documentation/quartzcore/catrans...
Approach is explained here: https://sciter.com/sciter-and-directx/ You see there exactly 3D, video and GUI around.