In theory one can have 640G = 8 * 80G A100s memory and launch it. 180B Falcon with fp16 will be 360G, so there would be enough memory. It's definitely going to be very expensive indeed.
If I'm paying a third party a hundred bucks a month, I'd at least want them to be able to match the capacities of consumer hardware.