The gaming market won't evaporate. If the market can't bear the new prices, Nvidia and AMD will just lower the prices.
A real example of price gouging would be a store charging a hundred dollars for bottled water after a hurricane, because people are desperate for it and can't get it elsewhere.
The situation in the gaming market is quite different. Gaming PCs in general, and high-end GPUs in particular, are luxury items, not necessities. There are no longer any meaningful GPU shortages, and there is an enormous secondary market that people can use if they don't want to pay the new prices.
Plus, these cards are the GPU equivalent of supercars -- looking at the Steam hardware survey, the number one GPU is the affordable RTX 1650, which only recently supplanted the 1060. Is Ferrari price-gouging because their cars cost more than Toyotas?