Thanks. What about the 70B model? I assume a 4090 will not be enough. Is it linear system requirements ?
It is mostly linear I think.
I will probably train how to fine tune on the small model but I don’t really need to use a worse model to save money.