What stops you from writing such data container with interior mutability, like vec_cell[0], which then enforce borrowing rules at runtime?

[0]: https://github.com/alexanderved/vec_cell