These virtual particles of which you describe appear to be of the particle being measured. So these aren’t just “some” virtual particles, they are THE particle you are trying to measure, only “ghosts” which react with nothing but themselves (so the particle only appears influenced by its own shadow particle, not those of others.
The multiverse conjecture does not necessarily conclude that whole, functional universes also exist (“out of phase” or something), it may be more like a dense plume of potential of which ours is a stable hyper dimensional manifestation. Ours may be the only one complete with stable laws of physics, where the other(s) are the vat of ghost particles refracting from whatever this manifest universe is doing.