Might this be what you're looking for: https://github.com/bigscience-workshop/petals ?