I suspect that depends on the chosen stored medium. I am assuming perhaps incorrectly that we could find a medium more durable than genetic material with known degeneration rates.
The first thing that comes to mind is the fictional society from the planet Krypton. They stored data in crystals, likely artificially created diamond material. I suspect we could do this today without consideration for cost.