I was building something really similar here https://ablepaint.dreammachine.one/ !