Maybe it's just semantics, but isn't the central model of ML to generate metadata (i.e. labels, classes, segmentation) and then operate on it?