In physics, particles not being labelled by anything other than their trajectories is a very natural starting point. When one uses the natural configuration space, one without labels in which a configuration is a set of n points in physical space rather than an ordered n-tuple, then the complex-valued wave functions on that space are exactly those of boson type. To get the fermions, one replaces the value space with a 1 dimensional complex bundle over the configuration space, one which twists in the right way. A paper I coauthored explores this in a general context: [1]
The "you" is then a rough set of particles whose trajectories roughly coincide with your macroscopic trajectory. Their identity is just given by where they are.
As for representations, I feel like I can easily understand how to get momentum or temperature from particles with their time evolution (trajectories), but I do not see how, say, to get positions of particle just from knowing what their momentums were and their time evolution.