Yeah, that's exactly what Parfit is trying to deal with.

https://plato.stanford.edu/entries/nonidentity-problem/