ParentFull threadswifthesitation·I don't think so. It seems to just lower the ram needed for the context window. Not for loading the model on the vram.View on HN