If you have two adjacent chunks, collapsing one will impose constraints on the other one. Even if the RNG part is deterministic, as you suggested, the result will be different depending on which chunk you collapse first.
If you randomly choose a point to start at (like the player avatar’s current position), then I see that you might get different tilings when regenerating the location.