sure the GPU isn't 4090 tier in compute, but the memory let's you run 120bn param models at usable speeds.