How big are these models that are downloaded? Is 7B 7 gigabytes of data?
You can see the actual size from hugging face. For example, https://huggingface.co/WizardLM/WizardLM-7B-V1.0/tree/main
Size with quantization, https://github.com/ggerganov/llama.cpp#quantization
7B = 7 Billions parameters.
If 1 parameter takes 1 byte then a 7B model would be about 7GB in size.
Usually 1 parameter takes 4 bytes tho (a 32-bit float), so it would be aboult 28GB.
You can use 16-bit, 8-bit or even 4-bit float.