The Microsoft LoRA is actually the same concept as the one applied here, the original method was applied to LLMs and then brough to diffusion models recently.