Hacker News Reader

Comment by fragmede | Hacker News Reader

So why not kubernetes?

K8S doesn't scale nearly as well due to etcd and latency sensitivity. Multi-site K8S is messy. The whole K8S model is overly-complex for what almost any org actually needs. Proxmox, Incus, and Nomad are much better designed for ease of use and large scale.

That said, I still run K8S in my homelab. It's an (unfortunately) important skill to maintain, and operators for Ceph and databases are worth the up-front trouble for ease of management and consumption.

multi-site k8s is also very "interesting" if you encounter anything like variable latency in your network paths. etcd is definitly not designed for use across large distances. (more then a 10km single mode fiber path).

wat? thats submillisecond. im not an etcd expert by any means, but nothing ive seen has given submillisecond as a performance criteria.

do you have a point of reference? this would definitely change some architecture items i’ve got on my list.

If I was building a k8s data center I'm not using etcd. Etcd is not a requirement.

Maintaining an external database as a replacement takes you off the blessed path, is it's own hassle to maintain high availability, and tarnishes the shiny hyperconvergance story. I'd be a lot more interested if Kine offered an embedded HA database like YugabyteDB, CockroachDB, TiDB, etc.

How would I run a Windows Server VM in Kubernetes?

Probably with KubeVirt.

Some instructions for Windows 11: https://kubevirt.io/2022/KubeVirt-installing_Microsoft_Windo...

Reply on news.ycombinator.com