This is a thing; it's called shadow call stack. Both ARM and now Intel have extensions for it.
I thought you were asking about the design of the hardware: it's designed that way because compatibility means that the vast majority of people want something backwards compatible.
Very little is fully "compiled from scratch" when you consider for example that libc is in the set of things that must be recompiled.
If one were to design a modern ISA from scratch it would make sense though.