I built something similar a couple of years back. Glad to see I wasn't alone in my itches

https://github.com/shikaan/shmux