Snapcast would likely work better for this use case - it handles audio endpoint synchronization.

https://github.com/badaix/snapcast