If I understand it correctly, GPUs use specialized high-bandwidth memory that is more expensive instead of commodity memory. See https://en.wikipedia.org/wiki/GDDR5_SDRAM.