The sperm cell is absorbed into the egg. The genetic material is taken into the nucleus and the rest of the cell is broken down and absorbed. The egg then turns into a more normal type of cell and starts dividing.

I suppose it's possible that that original cell will break down within the gestation period, but it would be in the center of the foetus and would be reabsorbed.

So, yes, probably