I'm more surprised you don't take a more quantum mechanical view of the problem. At vanishingly small scales, we know particles can come into existence provided they leave existence quickly enough to not effect the overall energy balance - but they're quite real, they mediate how forces in our universe operate, and have measurable parameters.
It does not seem inconceivable that all of space-time could be a similar sort of event: an bubble of higher-rules coming into existence spontaneously, and necessarily structured to not violate the rules of whichever higher-level system governs it (moreover: this could just be quantum mechanics, the same rules as us, operating at a large scale).
Which then gets to the interesting stuff: Poincare recurrence[1]. Dynamical systems after long but non-infinite times return to existing states - aka if the universe were regarded in such a way, then there is large but not infinite amount of time before it will return to either the "big bang" start state, or on an even longer timescale, any actual moment in time that ever happens.
Which is somewhat solipsistic of course, because it's all infinities anyway: an exact version of your atoms re-existing at multiple distantly separated points in time would be a multi-verse of sorts, just across another dimension: and of course if it's the same atoms, doing deterministically the same things, then it's essentially the same consciousness - so all those spaced repetitions of events aren't meaningfully distinct, so they're kind of the same...except they're also infinite, because they can just keep recurring.
[1] https://en.wikipedia.org/wiki/Poincar%C3%A9_recurrence_theor...