This isn't supposed to happen. Worst case scenario, the DMA-BUF is copied internally in the GPU from hidden memory to visible memory, and then back to the CPU.

Being able to export a DMA-BUF is necessary anyway for multi-GPU setups.

EDIT: fixed a s/GPU/CPU/ typo