It turns out it helped me a lot. I wanted to be able to explain how it helped, so that someone on the fence like I was would have an example of what types of problems it might address. I thought the best way to do it was visually.
Only problem was, I didn't have any web app experience. I taught myself React and with guidance from some friends I made something I'm really happy with. I went from no experience whatsoever in React, Next.JS, or Tailwind, and having never made a UI I've liked, to this.
(It is true that you can now use Oryx (https://ergodox-ez.com/pages/oryx) to tour a keyboard layout as well, but that wasn't true when I started. When it did get announced, I was far enough along that I wanted to finish it. Also, I am now editing my configuration by hand, not keeping it in Oryx anyway.)
(By the way, I'm not affiliated in any way with ZSA, the company that makes this board, and you can get open source ones from other places if you want.)