Not very big at all, I'm mirroring the whole thing, an individual state ranges from 29MB (Idaho) to about 375MB (California).

Some data-sets are available as "databases" that you can hook QGIS (or similar software) to directly. No need to download the whole thing, it'll stream only what's required in your viewport.