> One could still argue that time is just an ordinary dimension and the structure of the metric is just a property of how we measure distances.
The math doesn't work unless time is different from the 3 spatial dimensions. In particular, distances in space-time can be negative, unlike distances in space.