If you're interested in not reinventing the sandbox for LLMs, consider Judge0: https://judge0.com/
I have absolutely no relation to the project except for the fact that I went to the same Uni as the creator.
I have absolutely no relation to the project except for the fact that I went to the same Uni as the creator.
It's not quite right for what I'm after because you can't just "pip install" it on multiple platforms.