But physics as we understand it, isn't entirely deterministic.

There seem to be a number of other potentially important differences between living in a simulation and some other kind of "baseline" reality. One of those might be that a simulation sits inside of some kind of outer reality. It could therefore potentially be effected by that outer reality.