We're using Firecrackers [1] to power our sandboxes. Funnily enough, we had this repo sitting on our GitHub for about 6 months. We originally made this for one of our customers because they were running evals on the desktop-like environment with GUI for their model.
You can use PyAutoGUI [2] to control the whole environment programmatically.
The desktop-like environment is based on Linux and Xfce [3] at the moment. We chose Xfce because it's a fast and lightweight environment that's also popular and actively supported. However, this Sandbox template is fully customizable and you can create your own desktop environment.
Let me know if you have any questions.
Btw, we're hiring [4]!
[0] https://e2b.dev
[1] https://github.com/firecracker-microvm/firecracker