We used an A10 with 24GB of VRAM, this was enough for PEFT on Mistral-7B