The paper they’re basing this off already does this.

https://diamond-wm.github.io/