Google's Native Client was exactly this, but it never caught on. PNaCl is a proper subset of LLVM bytecode.