I wrote on the same issue when working on a VR desktop setup. if anyone finds it interesting:

https://rein4ce.medium.com/windows-desktop-vr-c405944b4853

My guess is we need at least 4K displays per eye for VR to be as readable as a 1080 monitor, without distortions beyond the sweet spot in the very center.

There were some Kickstarter projects a few years back for VR headset like this, but I guess none of them got any traction.