It would be great to see this approach as a part of PEFT library, so you don’t need to rely on custom code