Hacker News Reader

People may prefer running in environments that match their target production environment, so macOS is out of the question.

The Ubuntu that NVIDIA ship is not stock. They seem to be moving towards using stock Ubuntu but it’s not there yet.

Running some other distro on this device is likely to require quite some effort.

It still is more of a Linux distribution than macOS will ever be, UNIX != Linux.

I think the 'environment' here is CUDA; the OS running on the small co-processor you use to buffer some IO is irrelevant.

It's a hoop to jump through, but I'd recommend checking out Apple's container/containerization services which help accomplish just that.

You're likely still targeting Nvidia's stack for LLMs and Linux's containers on MacOS won't help you there.