The closest example outside Windows I can think of is the idea of "zones" in Solaris/Illumos/SmartOS. You can have a "LX branded zone" where the OS will respond to linux syscalls.

I don't know if the native solaris syscall interface is itself a zone, while Win32 is a subsystem on Windows.