No the Spark uses UEFI + ACPI
Regular Ubuntu or Fedora ISOs do work out of the box
Just needs the Nvidia GPU driver install afterwards
(And the realtek 10gbe module oot, or blocklist if not used)
Regular Ubuntu or Fedora ISOs do work out of the box
Just needs the Nvidia GPU driver install afterwards
(And the realtek 10gbe module oot, or blocklist if not used)
For Jetson Orin and later:
You can download an ISO from https://developer.nvidia.com/embedded/jetpack/downloads and that'll work. Other distributions are still a bit of a mess though but Yocto is supported now.
I basically treated it as a stock Ubuntu machine but on Aarch64, and ignored the stuff they installed. And then went looking for docker images for vllm that made sense and were up to date and hopefully tuned for NVFP4 on the hardware and...
... that was more the disappointing part.
I'm running vllm + GoModel on k3s, works like a charm. Even wrote some CUE last night to generate the values file for my Helm chart. It calculates the GPU percentage for me from the memGB I assign to a model.
Still, I'd rather have the blazing prefill speed of the Nvidia over my Strix Halo, but I wasn't willing to spend nearly twice as much for it (when I bought, the Strix Halo was $2100 and the GX10 was going for $3700, I think). Now that the difference between the two is much smaller, there's no reason to get the AMD.
I am not sure why NVIDIA couldn't have released a cheaper version of the thing with just standard Ethernet on it and leave it at that. Hardly anybody can afford two or more of them to cluster via ConnectX anyways.