405b even at low quants would have very low tokens generation speed, so even if you got the 192GB it would probably not be a good experience. I think 405b is the kind of model that only makes sense to run in clusters of A100/H100.

IMO it is not worth it, 70b models at q8 are already pretty darn good, and 128gb is more than enough for those.