Close your eyes. Imagine you are using your computer or phone, but that for tedious reasons you may only do so via the extremely lossy KVM that is me. Do you need to hear me say "yellow squiggle?"

The point of accessibility isn't an equivalent experience, which is trivially impossible in any case. The point is to make the material as useful, wherein possible. Especially when everything in the UI costs its user the time of its verbal description, "as useful" very often means ensuring the irrelevant is left out.