I don't see any documentation around libvps that claims it's safe to run on untrusted inputs, so you might want to run this thing in gVisor or a dedicated VM if that's your plan.
(I also looked for fuzz tests up the chain; libvips -> govips -> imagor, and didn't find any.)