Very interesting software. I would love it to have nix integration for systemd-nspawn or microvm. Would definitely try it out.
19 karma · joined August 16, 2017
I expect rapid progress in both model efficiency and hardware specialization. Local inference on edge devices, using chips designed specifically for AI workloads, will drastically reduce energy consumption for the majority of tasks. This shift will free up large-scale compute resources to focus on truly complex scientific problems, which seems like a worthwhile goal to me.
https://www.popularmechanics.com/technology/infrastructure/a...