See my other reply for page cites and details, but it seems that ZeniMax was actively pursuing VR technology and that Carmac was part of that project prior to his work on Oculus.

If I work for money developing a certain kind of technology, it's reasonable for my employer to think I won't give my work project over to another company and that they have some claim to that technology.