I wouldn't recommend PEFT unless you're only working with models pulled from the huggingface hub.