Going even deeper, from one moment to another - how do you know that you're you? After all, you're not _exactly_ the same, since each moment brings new experiences, ever so slightly changing your memories. Quantum entanglement, perhaps? If not, aren't we a collection of particles with a certain probability distribution that we're able to influence ourselves?

(Maybe this whole discussion is less interesting to Buddhists trained in not-self thinking. :)