What's your hardware? I've got 64GB RAM and a 4090 here, wondering if it's worth a play.
Unfortunately I don’t know about the best way of running on an Nvidia gpu, you could try llama.cpp and offloading as many layers as possible into the gpu and using RAM for the rest, not sure if that would slow it down too much though.