Show HN: Open Computer Use

Hi everyone, I'm Vasek (https://x.com/mlejva), the CEO of the company behind this - https://e2b.dev. The company is called E2B. We're an open-source (https://github.com/e2b-dev) devtool that makes it easy to run untrusted AI-generated code in our secure sandboxes. You can think of us as coding runtime for LLMs. You can self host us on GCP (https://github.com/e2b-dev/infra/blob/main/self-host.md) and we're working on AWS, then Azure, and any Linux machine.

This repo is one of our open-source projects that we're releasing to show developers what they can build with E2B. We used our sandboxes that are powered by AWS's Firecracker and gave them GUI with Linux. At the same time we made it easy to control this cloud computer with our Desktop SDK (https://github.com/e2b-dev/desktop). Essentially building a virtual desktop computer for AI and we gave it to LLMs to control it. Here's a demo we showed at an event - https://x.com/tereza_tizkova/status/1878834392891838556

We think computer use is still highly experimental but it feels sort of similar like AI codegen in early 2023. You see the sparks but it's not there just yet. However, we wanted to research if open-source LLMs could at least get some results. Here we're using Llama 3.2, Llama 3.3, and an OS-Atlas as a base model (fine-tuned Qwen).

If you have any questions, happy to answer them!

We're also hiring! If you're a fullstack engineer, distributed systems engineer, AI engineer, product designer, or GTM person and based in SF send me a hello to vasek @ e2b.dev!