LLVM isn't so much a VM for those languages to use directly as a portable assembly toolkit.

It's too low level to do compile to directly. It'd occupy a place in the stack somewhere near assembly, but with an optimizer in place. It's more of a VM toolkit than a VM itself.