Here's a vram requirements table for fine-tuning an LLM: https://github.com/hiyouga/LLaMA-Factory?tab=readme-ov-file#...
No matter how much vram you have, there's something that doesn't fit :)
No matter how much vram you have, there's something that doesn't fit :)