You could but then you would still be in the MacOS desktop environment. I think he doesn’t just want to run Linux applications but instead wants the Linux desktop environment.
The main issue with XQuartz nowadays is that it doesn't support Retina displays in windowed mode. Everything runs pixel-doubled by default.
There are only two options: hack Virgil 3D or hack XQuartz. You cannot "just" run XQuartz and solve problems. And I choose hacking Virgil 3D because it should have less communication overhead and work with Wayland.