Hacker News Reader

Comment by sandGorgon | Hacker News Reader

can you run kubernetes in nestybox ? entirely within the container ?

if you can do this (and build a great experience around it), you have a winner.

k3d.io does it somewhat...but not all the way. Updates,rollbacks, etc - everything that a sysadmin need.

Yes, it's possible already to run K8s entirely inside a system container deployed with Docker + Sysbox. It's as easy as "docker run --runtime=sysbox-runc -it some-image" and running kubeadm inside to setup K8s. We also have images that come preloaded with K8s to make it easier.

Here is a demo video: https://asciinema.org/a/V1UFSxz6JHb3rdHpGrnjefFIt?speed=1.75

Having said this, K8s is very complex and while its most common functionality works inside the container, we've not yet tested it all.

Here is a doc that describes this in more detail, including what is supported and not supported at this time: https://github.com/nestybox/sysbox/blob/master/docs/user-gui...

We also created a simple tool called kindbox that runs K8s inside system containers deployed with Docker + Sysbox. It's a simple bash script around "docker run --runtime=sysbox" commands. It does some of the same things that K8s.io KinD tool does, but using simpler Docker images and without using privileged containers. It's meant as a reference example to show developers how to deploy K8s clusters using Docker + Sysbox.

You can find kindbox here if you are curious: https://github.com/nestybox/kindbox

Yes.

Having said that, we have certain limitations at the moment (e.g. we don't run all cni's), but we are not relying on priv containers as i believe is the case for existing K8s-in-docker solutions (pls correct me if i'm wrong in k3d's case).

Btw, we haven't tested k3d.io & sysbox interaction yet (part of our roadmap), but i believe we should be able to interoperate after making some minor adjustments. That would allow existing k3d users to operate in a more secure environment.

> can you run kubernetes in nestybox ? entirely within the container ?

> if you can do this (and build a great experience around it), you have a winner.

Genuine question. I'm not that familiar with Kubernetes. Can you explain the pain this solves? What is this winning at?

There is plenty of info on Kubernetes (K8s) on the web, so I would start there. As far as running K8s inside Docker containers though, the use case would be one in which you want to run multiple isolated K8s clusters on a single host. One way is to use VMs, but recently people are resorting to using containers for this purpose due to their ease & efficiency. It's in the latter that Sysbox really helps, because it's capable of creating a container that runs K8s easily and with proper isolation. Typical use cases are testing, CI/CD, learning. But I would not discount this moving into production use cases in the future as the technology matures.

Reply on news.ycombinator.com