LLVM IR and codegen tooling are both solutions to performance, not expressivity. The ergonomics of a language that will never go to production are irrelevant.
Common Lisp also lets you easily compile your language to assembly. To get that additional llvm benefit is at least 2 orders of magnitude of effort, but it’s probably not 2 orders of magnitude faster.