I’ve thought about building something similar, but for an arbitrary number of sound sources, with a single flying fader, a small mono display for icons, and some buttons.

…hang on a minute, it already (kind of) exists: https://www.elgato.com/us/en/p/stream-deck-plus-black