The real question for me is if consciousness is even real/physical or just an illusion. After you die time has no meaning and we don't know what happens trillions and trillions of years from that point. Maybe with limited matter or infinity, the exact universe patterns emerge once again that give you consciousness. Maybe you are reborn again in the same identical universe that contains your biological pattern, and live your life again and again without knowing you have done it before. Since you have no perception of time when dead, it happens instantly. Does it have to be 100% identical or are some variations allowed? Maybe you live through every possible variation of your biological self.
Or maybe quantum immortality occurs, where your consciousness jumps into a universe where you are still alive despite all the odds.
Or perhaps the universe is just snapshots of infinite patterns locked in permanent static states and this entire progression of time, physics, etc is just an illusion created by the sub-process of consciousness that creates dynamic transitions from one state to another.
It's probably my inability to perceive the concept of infinity that my mind thinks about such things, either way we will probably never know.