Almost like we should use, you know, units of length, when measuring lengths/widths/etc.
One might argue that the size on their label is not supposed to indicate the size of the garment waistband, but the waist size of the wearer who would find it comfortable, but even with that interpretation it doesn't work out right.
Charles Tyrwhitt have this guide where they tell you what to measure for shirts :
https://www.charlestyrwhitt.com/au/size-guides/szg-formal-sh...
and for trousers :
https://www.charlestyrwhitt.com/au/szg-trousers-4-2021.html
Presumably some online shops for women have something similar?