It is not precious if you don't run LLMs or play games. For many people like myself, video card is idle most of the time.
Using its ram to speed-up compilation or similar is not a bad idea.
It would be interesting to have something that used VRAM when there was no other demand and regular RAM otherwise.
Even gamers and (most) LLM users are not using the GPU all the time.