Looks like new features coming up in DirectX 12 updates will allow for more access to VRAM as well.

https://www.tomshardware.com/news/dx12-optimization-cpu-gpu-...