Methods that expect the same input to map to the same output don't work with feedback.
There's no longer a concept of training examples to be close to, since it's just going along the gradient of high reward actions in the RL environment and going away from those with low reward.