The buffer was not being edited when the replacement was shown to be happening. The plugin anzu uses overlays[1] to show the text being replaced and the replacements.

[1]: https://www.gnu.org/software/emacs/manual/html_node/elisp/Ov...