> Do you have to be on NixOS to use the OCI images outputtable by nixpks/nix package manager

No

> can you build OCI images using Nix from Mac/Windows/other non NixOS Linux?

Non NixOS Unix, not Windows yet, unless you use WSL or a VM