False dichotomy. Toggle buttons should show both and visually indicate the state by proximity cue.

But there is usability vs aesthetics trade off.

I think Microsoft design systems (seen in Windows, Edge, Office products) only shows the active state probably because it’s easier to align toggle buttons flush when text is only on one side. If you display texts on both sides, the unpredictable text length would make the button area difficult to align.